Computer-assisted data processing system and method incorporating automated learning

ABSTRACT

A technique is provided for enhancing performance of computer-assisted data operating algorithms in a medical context. Datasets are compiled and accessed, which may include data from a wide range of resources, including controllable and prescribable resources, such as imaging systems. The datasets are analyzed by a human expert or medical professional, and the algorithms are modified based upon feedback from the human expert or professional. Modifications may be made to a wide range of algorithms and based upon a wide range of data, such as available from an integrated knowledge base. Modifications may be made in sub-modules of the algorithms providing enhanced functionality. Modifications may also be made on various bases, including patient-specific changes, population-specific changes, feature-specific changes, and so forth.

BACKGROUND OF THE INVENTION

[0001] The present invention relates generally to field of medical dataprocessing, acquisition and analysis. More particularly, the inventionrelates to techniques for drawing upon a wide range of available medicaldata for informing decisions related to diagnosis, treatment, furtherdata processing, acquisition and analysis.

[0002] In the medical field many different tools are available forlearning about and treating patient conditions. Traditionally,physicians would physically examine patients and draw upon a vast arrayof personal knowledge gleaned from years of study to identify problemsand conditions experienced by patients, and to determine appropriatetreatments. Sources of support information traditionally included otherpractitioners, reference books and manuals, relatively straightforwardexamination results and analyses, and so forth. Over the past decades,and particularly in recent years, a wide array of further referencematerials have become available to the practitioner that greatly expandthe resources available and enhance and improve patient care.

[0003] Among the diagnostic resources currently available to physiciansand other caretakers are databases of information as well as sourceswhich can be prescribed and controlled. The databases, are somewhat toconventional reference libraries, are know available from many sourcesand provide physicians with detailed information on possible diseasestates, information on how to recognize such states, and treatment ofthe states within seconds. Similar reference materials are, of course,available that identify such considerations as drug interactions,predispositions for disease and medical events, and so forth. Certain ofthese reference materials are available at no cost to care providers,while other are typically associated with a subscription or communitymembership.

[0004] Specific data acquisition techniques are also known that can beprescribed and controlled to explore potential physical conditions andmedical events, and to pinpoint sources of potential medical problems.Traditional prescribable data sources included simple blood tests, urinetests, manually recorded results of physical examinations, and the like.Over recent decades, more sophisticated techniques have been developedthat include various types of electrical data acquisition which detectand record the operation of systems of the body and, to some extent, theresponse of such systems to situations and stimuli. Even moresophisticated systems have been developed that provide images of thebody, including internal features which could only be viewed andanalyzed through surgical intervention before their development, andwhich permit viewing and analysis of other features and functions whichcould not have been seen in any other manner. All of these techniqueshave added to the vast array of resources available to physicians, andhave greatly improved the quality of medical care.

[0005] Despite the dramatic increase and improvement in the sources ofmedical-related information, the prescription and analysis of tests anddata, and the diagnosis and treatment of medical events still relies toa great degree upon the expertise of trained care providers. Input andjudgment offered by human experience will not and should not be replacedin such situations. However, further improvements and integration of thesources of medical information are needed. While attempts have been madeat allowing informed diagnosis and analysis in a somewhat automatedfashion, these attempts have not even approached the level ofintegration and correlation which would be most useful in speedy andefficient patient care.

[0006] An increasing number of applications are being developed forautomated analysis of medical-related data. Techniques have beendeveloped, for example, in the medical imaging context for segmentingpathologies, identifying such features and classifying the features forpossible diagnosis and treatment. However, limited integration of suchprograms has been provided in the past, and due to the very limitedintegration of data resources, little or no activity has focused onenhancing the performance of such algorithms by novel learningtechniques. Such algorithms are typically refined by laborious featurerecognition and reprogramming by teams of programmers and technicians.

[0007] There is a need, therefore, for an improved technique that wouldpermit refinement of computer-assisted data analysis algorithms in themedical context. There is a particular need for techniques which canoperate on existing and future algorithms to enhance their performanceat all levels of functionality to approach and even surpass thecapabilities of human readers of data.

BRIEF DESCRIPTION OF THE INVENTION

[0008] The present invention provides techniques for improving operationof computer-assisted data operating algorithms designed to respond tosuch needs. In accordance with a first aspect of the technique, a methodis provided that includes analyzing a dataset via a computer-assisteddata operating algorithm to generate a result dataset identifying afeature of interest. Changes in the result dataset are then monitoredbased upon input from a human expert. At least one sub-module of thecomputer-assisted data operating algorithm is then modified withoutoperator intervention based upon the modified result dataset.

[0009] In accordance with another aspect of the technique, a method forimproving performance of a computer-assisted medical data operatingalgorithm includes analyzing a dataset via a computer-assisted dataoperating algorithm to generate a result dataset identifying a featureof interest and modifying at least on sub-module of thecomputer-assisted data operating algorithm on a patient-specific basis.

[0010] In accordance with a further aspect of the invention, a methodfor improving performance of a computer-assisted data operatingalgorithm includes accessing image data derived from a medical imagingsystem, and supplemental data from an integrated knowledge baseincluding clinical and non-clinical data from a plurality ofcontrollable and prescribable resources. The image data and thesupplemental data are analyzed via a computer-assisted data operatingalgorithm to generate a result dataset identifying a feature of interestin the image data. The result dataset is then modified based uponcorrection by a human medical professional. At least one sub-model ofthe computer-assisted data operating algorithm is modified based uponthe modified result dataset.

[0011] The invention further provides systems and computer programsdesigned to implement similar procedures.

[0012] The present invention provides novel techniques for handling ofmedical data designed to provide such enhanced care. The techniques maydraw upon the full range of available medical data, which may beconsidered to be included in an integrated knowledge base. Theintegrated knowledge base, itself, may be analytically subdivided intocertain data resources and other controllable and prescribableresources. The data resources may include such things as databases whichare patient-specific, population-specific, condition-specific, or thatgroup any number of factors, including physical factors, geneticfactors, financial and economic factors, and so forth. The controllableand prescribable resources may include any available medical dataacquisition systems, such as electrical systems, imaging systems,systems based upon human and machine analyses of patients and tissues,and so forth. Based upon such data, routines executed by one or anetwork of computer systems, defining a general processing system, canidentify and diagnose potential medical events. Moreover, the processingsystem may prescribe additional data acquisition from the controllableand prescribable resources, including additional or different types ofdata during a single time period, or the same or different types of dataover extended periods of time.

[0013] The analyses of the medical data available to the logic enginemay be employed for a number of purposes, first and foremost for thediagnosis and treatment of medical events. Thus, patient care can beimproved by more rapid and informed identification of disease states,medical conditions, predispositions for future conditions and events,and so forth. Moreover, the system allows for more rapid, informed,targeted and efficient data acquisition, based upon such factors as themedical events or conditions which are apt to be of greatest priority orimportance. The system enables other uses, however. For example, basedupon knowledge programmed or gained over time, the system providesuseful training tools for honing the skills of practitioners. Similarly,the system offers great facility in providing high-quality medical carein areas or in situations where the most knowledgeable care provider andmost appropriate information gathering systems may simply beunavailable.

[0014] In short, it is believed that the present techniques provide thehighest level of integration of both data resources, and prescribableand controllable resources currently possible in the field. This systemmay be implemented in a more limited fashion, such as to integrate onlycertain types of resources or for the purposes of data acquisition andanalysis alone. However, even in such situations, the system may befurther expanded by the inclusion of software, firmware or hardwaremodules, or by the coupling of additional or different data sourcesalong with their correlation to other data sources in the analysesperformed by the processing system. The resulting system, in conjunctionwith existing and even future sources of medical data, provides acompliment and an extremely useful linking tool for the experiencedpractitioner, as well as for the less experienced clinician inidentifying and treating medical events and conditions. This system maybe further employed for targeting very specific conditions and events asdesired.

BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The foregoing and other advantages and features of the inventionwill become apparent upon reading the following detailed description andupon reference to the drawings in which:

[0016]FIG. 1 is a general overview certain exemplary functionalcomponents within a computer-aided medical data handling system and ofdata flow between the components in accordance with aspects of thepresent techniques;

[0017]FIG. 2 is a diagrammatical representation of certain exemplarycomponents of a data processing system of the type illustrated generallyin FIG. 1;

[0018]FIG. 3 is a diagrammatical representation of certain exemplarydata resources that could form part of a knowledge base employed in thesystem of FIG. 1;

[0019]FIG. 4 is a diagrammatical representation of certain exemplary ofthe controllable and prescribable resources that may be employed in thesystem of the type illustrated in FIG. 1;

[0020]FIG. 5 is a general diagrammatical representation of exemplarymodules within a controllable and prescribable resource, as well ascertain modules which could be included in a data processing system inaccordance with aspects of the present technique;

[0021]FIG. 6 is a diagrammatical representation of the overall structureof certain prescribable and controllable data resources, illustratingthe availability of various modality resources within certain types andover certain time periods;

[0022]FIG. 7 is a diagrammatical representation of flow of informationbetween certain data resource types as shown in FIG. 6, over certaintime periods, and manners in which the information may be tied into thedata processing system for analysis and prescription of additional dataacquisition, processing or analysis;

[0023]FIG. 8 is a tabulated representation of a range of exemplaryprescribable and controllable medical data resources organized by typeand illustrating the various modalities of resources within the types;

[0024]FIG. 9 is a general diagrammatical representation of a typicalexemplary electrical data resource as mentioned in FIG. 8, which mayinclude various general components or modules for acquiring electricaldata representative of body function and state;

[0025]FIG. 10 is a general diagrammatical representation of certainfunctional components of a medical diagnostic imaging system as one ofthe prescribable and controllable resources mentioned in FIG. 9;

[0026]FIG. 11 is a diagrammatical representation of an exemplary X-rayimaging system which may be employed in accordance with certain aspectsof the present technique;

[0027]FIG. 12 is a diagrammatical representation of an exemplarymagnetic resonance imaging system which may be employed in thetechnique;

[0028]FIG. 13 is a diagrammatical representation of an exemplarycomputed tomography imaging system for use in the technique;

[0029]FIG. 14 is a diagrammatical representation of an exemplarypositron emission tomography system for use in the technique;

[0030]FIG. 15 is a diagrammatical overview of an exemplary neuralnetwork system which may be used to establish and configure theknowledge base in accordance with aspects of the present technique;

[0031]FIG. 16 is a diagrammatical overview of an expert system which maysimilarly be used to program and configure a knowledge base;

[0032]FIG. 17 is a diagrammatical overview of certain components of thesystem in accordance with the present technique illustrating interactionbetween the federated database, the integrated knowledge base, dataprocessing system, and an unfederated interface layer for acquiringinformation from a series of clinicians, and for providing informationfor output;

[0033]FIG. 18 is a diagrammatical flow chart of a series of processingstrings which may be initiated in various manners to acquire, analyzeand output information from the resources and knowledge base establishedby the present techniques;

[0034]FIG. 19. is a diagrammatical flow chart of certain events andprocesses which may take place over time to acquire patient informationby patient interaction, perform system interactive functions, and outputinformation for users, including patients and clinicians;

[0035]FIG. 20 is a diagrammatical representation of certain componentsand functions available for refining user access to the integratedknowledge base and for defining user-specific interfaces for interactingwith the integrated knowledge base;

[0036]FIG. 21 is a diagrammatical representation of levels in aclustered architecture implemented in aspects of the present technique;

[0037]FIG. 22 is flowchart illustrating various functions carried out atdifferent levels of the architecture of FIG. 21;

[0038]FIG. 23 is a flowchart illustrating components and processes in apatient-managed integrated record system;

[0039]FIG. 24 is a flowchart illustrating exemplary components and stepsin a predictive model development system;

[0040]FIG. 25 is a flowchart illustrating functions carried out in apredictive model development module of the type illustrated in FIG. 24;

[0041]FIG. 26 is a flowchart illustrating a technique for refining ortraining a computer-assisted algorithm and a medical professional;

[0042]FIG. 27 is a flowchart illustrating processing steps for in vitrosample processing and analysis;

[0043]FIG. 28 is a diagrammatical representation of a CAX systemincluding one or more CAX algorithms in accordance with aspects of thepresent technique;

[0044]FIG. 29 is a diagrammatical representation of the CAX algorithmsof FIG. 28 and functions and operators employed by the algorithms;

[0045]FIG. 30 is a diagrammatical representation of a scheme forimplementing CAX algorithms in parallel and/or in series to evaluate arange of conditions and situations; and

[0046]FIG. 31 is a diagrammatical representation of a computer-assistedassessment algorithm which may serve as one of the CAX algorithmsimplemented.

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS

[0047] Turning now to the drawings, and referring first to FIG. 1, anoverview of a computer aided medical data exchange system 2 isillustrated. The system 2 is designed to provide high-quality medicalcare to a patient 4 by facilitating the management of data available tocare providers, as indicated at reference numeral 6 in FIG. 1. The careproviders will typically include attending physicians, radiologist,surgeons, nurses, clinicians, various specialists, and so forth. Itshould be noted, however, that while general reference is made to aclinician in the present context, the care providers may also includeclerical staff, insurance companies, teachers and students, and soforth.

[0048] The system illustrated in FIG. 1 provides an interface 8 whichallows the clinicians to exchange data with a data processing system 10.More will be said regarding the types of information which can beexchanged between the system and the clinicians, as well as about theinterfaces and data processing system, and their functions. The dataprocessing system 10 is linked to an integrated knowledge base 12 and afederated database 14, as illustrated in FIG. 1. System 10, and thefederated database 14 draw upon data from a range of data resources, asdesignated generally by reference numeral 18. The federated database 14may be software-based, and includes data access tools for drawinginformation from the various resources as described below, orcoordinating or translating the access of such information. In general,the federated database will unify raw data into a useable form. Anysuitable form may be employed, and multiple forms may be employed, wheredesired, including hypertext markup language (HTML) extended markuplanguage (XML), Digital Imaging and Communications in Medicine (DICOM),Health Level Seven® (HL7), and so forth. In the present context, theintegrated knowledge base 12 is considered to include any and all typesof available medical data which can be processed by the data processingsystem and made available to the clinicians for providing the desiredmedical care. In the simplest implementation, the resources 18 mayinclude a single source of medical data, such as an imaging system, ormore conventional data extraction techniques (e.g. forms completed by apatient or care provider). However, the resources may include many moreand varied types of data as described more fully below. In general, datawithin the resources and knowledge base are digitized and stored to makethe data available for extraction and analysis by the federated databaseand the data processing system. Thus, even where more conventional datagathering resources are employed, the data is placed in a form whichpermits it to be identified and manipulated in the various types ofanalyses performed by the data processing system.

[0049] As used herein, the term “integrated knowledge base” is intendedto include one or more repositories of medical-related data in a broadsense, as well as interfaces and translators between the repositories,and processing capabilities for carrying out desired operations on thedata, including analysis, diagnosis, reporting, display and otherfunctions. The data itself may relate to patient-specificcharacteristics as well as to non-patient specific information, as forclasses of persons, machines, systems and so forth. Moreover, therepositories may include devoted systems for storing the data, or memorydevices that are part of disparate systems, such as imaging systems. Asnoted above, the repositories and processing resources making up theintegrated knowledge base may be expandable and may be physicallyresident at any number of locations, typically linked by dedicated oropen network links. Furthermore, the data contained in the integratedknowledge base may include both clinical data (i.e. data relatingspecifically to a patient condition) and non-clinical data. Non-clinicaldata may include data representative of financial resources, physicalresources (as at an institution or supplier), human resources, and soforth.

[0050] The flow of information, as indicated by the arrows in FIG. 1,may include a wide range of types and vehicles for information exchange,as described more fully below. In general, the patient 4 may interfacewith clinicians 6 through conventional clinical visits, as well asremotely by telephone, electronic mail, forms, and so forth. The patient4 may also interact with elements of the resources 18 via a range ofpatient data acquisition interfaces 16, which may include conventionalpatient history forms, interfaces for imaging systems, systems forcollecting and analyzing tissue samples, body fluids, and so forth.Interaction between the clinicians 6 and the interface 8 may take anysuitable form, typically depending upon the nature of the interface.Thus, the clinicians may interact with the data processing system 10through conventional input devices such as keyboards, computer mice,touch screens, portable or remote input and reporting devices. Moreover,the links between the interface 8, data processing system 10, theknowledge base 12, the federated database 14 and the resources 18 willbe described more fully below, but may typically include computer dataexchange interconnections, network connections, local area networks,wide area networks, dedicated networks, virtual private network, and soforth.

[0051] As noted generally in FIG. 1, the data processing andinterconnection of the various resources, databases, and processingcomponents can vary greatly. For example, FIG. 1 illustrates thefederated database as being linked to both the data processing system 10and to the resources 18. Such arrangements will permit the federateddatabase, and the software contained therein, to extract and accessinformation from various resources, while providing the information tothe data processing system 10 upon demand. The data processing system10, in certain instances, may directly extract or store information inthe resources 18 where such information can be accessed and interpretedor translated. Similarly, the data processing system 10 can be linked tothe integrated knowledge base 12 and both of these components can belinked to the interface 8. The interface 8, which may be subdivided intospecific interface types or components, may thus be used to accessknowledge directly from the integrated knowledge base 12, or to commanddata processing system 10 to acquire, analyze, process or otherwisemanipulate data from the integrated knowledge base or the resources.Such links between the data are illustrated diagrammatically in thefigures for explanatory purposes. In specific systems, however, the highdegree of integration may follow specific software modules or programswhich perform specific analyses or correlations for specific patients,specific disease states, specific institutions, and so forth.

[0052] Throughout the present discussion, the resources 12 will beconsidered to include two primary types of resource. First, a purelydata resource may consist of various types of previously-acquired,analyzed and stored data. That is, the data resources may be thought ofas reference sources which may represent information regarding medicalevents, medical conditions, disease states, financial information, andso forth, as discussed more fully below. The data resources do not, ingeneral, require information to be gathered directly from the patient.Rather, these resources are more general in nature and may be obtainedthrough data reference libraries, subscriptions, and so forth. A secondtype of resource comprising knowledge base 12 consists of controllableand prescribable resources. These resources include any number of datagathering devices, mechanisms, and procedures which acquire datadirectly or indirectly from the patient. More will be said of theseresources later in the present discussion, but, in general they may bethought of as clinical resources such as imaging systems, electricalparameter detection devices, data input by clinicians in fully orpartially-automated or even manual procedures, and so forth.

[0053]FIG. 2 illustrates in somewhat greater detail the types ofcomponents associated with the data processing system 10. In general,the data processing system 10 may include a single computer, but formore useful and powerful implementations, a wide array of computing andinterface resources. Such resources, designated generally at referencenumeral 20, may include application-specific computing devices, generalpurpose computers, servers, data storage devices, and so forth. Suchdevices may be positioned at a single principle location, but also maybe widely geographically placed and drawn upon as desired, such as viawide area networks, local area networks, virtual private networks, andso forth. The computing resources draw upon and implement programs,designated generally at reference numeral 22, which codify and directthe data extraction, analysis, compilation, reporting and similarfunctions performed by the data processing system. In general, suchprograms may be embodied in software, although certain programs may behard-wired into specific components, or may constitute firmware withinor between certain components. As described more fully below, theprograms 22 may be considered to include certain logic engine components24 which drive the analysis functions performed by the data processingsystem 10. Such logic engine components may assist in diagnosis ofmedical events and conditions, but may also be used for a wide range ofother functions as described below. Such functions may includeprescription and control of the controllable and prescribable resources,proposals for patient care, analysis of financial arrangements andconditions, analysis of patient care, teaching and instruction, tomention but a few of the possible applications.

[0054] The computing resources 20 are designed to draw upon andinterface with the data resources discussed above via data resourceinterfaces 26, which may be part of federated database 14 (see, FIG. 1).Moreover, the data resource interfaces 26 will typically includecomputer code stored both at the computing resources 20 and additionalcode which may be stored within these specific data resources, as wellas code that permits communication between the computing resources andthe data resources. Accordingly, such code will permit information to besearched, extracted, transmitted, and stored for processing by thecomputing resources. Moreover, the data resource interfaces 26 willallow for data to be sent from the computing resources, where desired,and stored within the data resources. When necessary, the data resourceinterfaces will also permit translation of the data from one form toanother so as to facilitate its retrieval, analysis, and storage. Suchtranslation may include compression and decompression techniques, fileformatting, and so forth.

[0055] The computing resources 20 also interface with the controllableand prescribable resources via interfaces 28, which may also be includedin the federated database. Like interfaces 26, interfaces 28 may includecode stored, as noted above at the computer resources, as well as codesstored at the specific locations or systems which comprise thecontrollable and prescribable resources. Thus, the interfaces willtypically include code which identifies types of information sought,permitting location and extraction of the information, translation ofthe information, where necessary, manipulation of the information andstorage of the information. The interfaces may also permit informationto be loaded to the controllable and prescribable resources from thecomputing resources, such as for configurations of systems andparameters for carrying out examinations, reports, and so forth. Itshould also be noted that certain of the computing resources mayactually be located at or even integral with certain of the controllableand prescribable resources, such as computer systems and controllerswithin imaging equipment, electrical data acquisition equipment, orother resource systems. Thus, certain of the operations and analysisperformed by the logic engine components 24 or, more generally, by theprograms 22, may be implemented directly at or local to the controllableand prescribable sources.

[0056] Also illustrated in FIG. 2 is a network 29 which is showngenerally linked to the data processing system 10. The network 29, whilepossibly including links to the data resource interfaces, the dataresources, the controllable and prescribable resources, and so forth,may provide additional links to users, institutions, patients, and soforth. Thus, the network 29 may route data traffic to and from thevarious components of the data processing system 10 so as to permit datacollection, analysis and reporting functions more generally to a widerrange of participants.

[0057] As noted by the arrows in FIG. 2, a wide range of networkconfigurations may be available for communicating between and among thevarious resources and interfaces. For example, as noted by arrow 30, thecomputing resources 20 may draw upon program 22 both directly (e.g.internally of computer systems), or via local or remote networking.Thus, the computing resources may permit execution of routines basedupon programs stored and accessed on an “as-needed” basis, in additionto programs immediately accessible from within specific computersystems.

[0058] Arrows 31 and 32 represent, generally, more varied datainterchange pathways, such as configurable and dedicated networks, thatallow for high-speed data exchange between the various resources.Similar communications may be facilitated between the data resourceinterfaces and the controllable and prescribable resource interfaces asnoted at arrow 33 in FIG. 2. Such exchanges may be useful for drawingupon specific data resource information in configuring or operating thecontrollable and prescribable resources. By way of example, the dataresource interfaces may permit extraction of population information,“best practice” system configurations, and so forth which can be storedwithin the controllable and prescribable resources to facilitate theiroperation as dictated by analysis performed by the computing resources.Arrows 34 refer generally to various data links between the interfaces26 and 28 and the components of the knowledge base as described below,such links may include any suitable type of network connection or eveninternal connections within a computer system. In a case of all of thedata communications 30, 31, 32, 33 and 34, any range of network or datatransfer means may be envisaged, such as data busses, dial-up networks,high-speed broadband data exchanges, wireless networks, satellitecommunication systems, and so forth.

[0059] Data Resources

[0060]FIG. 3 illustrates certain exemplary components which may beincluded within the data resource segment of the resources discussedabove and illustrated in FIG. 1. The data resources denoted generally atreference numeral 38 in FIG. 3, are designed to communicate with thedata processing system 10 as noted above with reference to FIG. 2 and asindicated by arrows 35 in FIG. 3. In turn, the data processing system isavailable as a resource to clinicians 6 via interface 8 and may furthercommunicate with the controllable and prescribable resources 40 asindicated by arrows 36. As noted in FIG. 3, the clinicians may havedirect access and interface directly with the data processing system, oraccess to the data processing system 10 indirectly via remotenetworking-arrangements as denoted by the straight and broken arrows 37.

[0061] The data processing system, in addition to drawing upon andcommunicating with the data resources 38, communicates with thecontrollable and prescribable resources as indicated at referencenumeral 40 and discussed more fully below. As noted above, the dataresources may generally be thought of as including information and datawhich can be identified, localized, extracted and utilized by the dataprocessing system 10. Moreover, the data processing system may writedata to the various resources where appropriate.

[0062] As illustrated in FIG. 3, the data resources 38 may include arange of information types. For example, many sources of information maybe available within a hospital or institution as indicated at referencenumeral 42. As will be appreciated by those skilled in the art, theinformation may be included within a radiology department informationsystem 44, such as in scanners, control systems, or departmentalmanagement systems or servers. Similarly, such information may be storedin an institution within a hospital information system 46 in a similarmanner. Many such institutions further include data, particularly imagedata, archiving systems, commonly referred to as PACS 48 in the form ofcompressed and uncompressed image data, data derived from such imagedata, data descriptive of system settings used to acquire images (suchas in DICOM or other headers appended to image files), and so forth. Inaddition to data stored within institutions, data may be available frompatient history databases as indicated at reference numeral 50. Suchdatabases, again, may be stored in a central repository within aninstitution, but may also be available from remote sources to providepatient-specific historical data. Where appropriate, such patienthistory databases may group a range of resources searchable by the dataprocessing system and located in various institutions or clinics.

[0063] Other data resources may include databases such as pathologydatabases 52. Such databases may be compiled both for patient-specificinformation, as well as for populations of patients or persons sharingmedical, genetic, demographic, or other traits. Moreover, externaldatabases, designated generally by reference numeral 54, may beaccessed. Such external databases may be widely ranging in nature, suchas databases of reference materials characterizing populations, medicalevents and states, treatments, diagnosis and prognosischaracterizations, and so forth. Such external databases may be accessedby the data processing system on specific subscription bases, such as onongoing subscription arrangements or pay-per-use arrangements.Similarly, genetic and similar databases 56 may be accessed. Suchgenetic databases may include gene sequences, specific genetic markersand polymorphisms, as well as associations of such genetic informationwith specific individuals or populations. Moreover, financial, insuranceand similar databases 58 may be accessible for the data processingsystem 10. Such databases may include information such as patientfinancial records, institution financial records, payment and invoicingrecords and arrangements, Medicaid or Medicare rules and records, and soforth.

[0064] Finally, other databases, as denoted at reference numeral 60 maybe accessed by the data processing system. Such other databases may,again, be specific to institutions, imaging or other controllable orprescribable data acquisition systems, reference materials, and soforth. The other databases, as before, may be available free or eveninternal to an institution or family of institutions, but may also beaccessed on a subscription bases. Such databases may also bepatient-specific, or population-specific to assist in the analysis,processing and other functions carried out by the data processing system10. Furthermore, the other databases may include information which isclinical and non-clinical in nature. For assistance in management offinancial and resource allocation, for example, such databases mayinclude administrative, inventory, resource, physical plant, humanresource, and other information which can be accessed and managed toimprove patient care.

[0065] As indicated by the multiple-pointed arrow in the data resourcesgrouping 38 in FIG. 3, the various data resources may also communicatebetween and among themselves. Thus, certain of the databases or databaseresources may be equipped for the direct exchange of data, such as tocomplete or compliment data stored in the various databases. While suchdata exchange may be thought of generally as passing through the dataprocessing system 10, in a more general respect, the resources mayfacilitate such direct data exchange as between institutions, datarepositories, computer systems, and the like with the data processingsystem 10 drawing upon such exchange data from one or more of theresources as needed.

[0066] Controllable/Prescribable Resources

[0067]FIG. 4 similarly indicates certain of the exemplary controllableand prescribable resources which may be accessed by the data processingsystem 10. As before, the data processing system is designed tointerface with clinicians 6 through appropriate interfaces 8, as well aswith the data resources 3 8.

[0068] In general, the controllable and prescribable resources 40 may bepatient-specific or patient-related, that is, collected from directaccess either physically or remotely (e.g. via computer link) from apatient. The resource data may also be population-specific so as topermit analysis of specific patient risks and conditions based uponcomparisons to known population characteristics. It should also be notedthat the controllable and prescribable resources may generally bethought of as processes for generating data. Indeed, while may of thesystems and resources described more fully below will themselves containdata, these resources are controllable and prescribable to the extentthat they can be used to generate data as needed for appropriatetreatment of the patient. Among the exemplary controllable andprescribable resources 40 are electrical resources denoted generally atreference numeral 62. Such resources, as described more fully below, mayinclude a variety of data collection systems designed to detectphysiological parameters of patients based upon sensed signals. Suchelectrical resources may include, for example, electroencephalographyresources (EEG), electrocardiography resources (ECG), electromyographyresources (EMG), electrical impedance tomography resources (EIT), nerveconduction test resources, electronystagmography resources (ENG), andcombinations of such resources. Moreover, various imaging resources maybe controlled and prescribed as indicated at reference numeral 64. Anumber of modalities of such resources are currently available, such asX-ray imaging systems, magnetic resonance (MR) imaging systems, computedtomography (CT) imaging systems, positron emission tomography (PET)systems, flouorography systems, mammography systems, sonography systems,infrared imaging systems, nuclear imaging systems, thermoacousticsystems, and so forth.

[0069] In addition to such electrical and highly automated systems,various controllable and prescribable resources of a clinical andlaboratory nature may be accessible as indicated at reference numeral66. Such resources may include blood, urine, saliva and other fluidanalysis resources, including gastrointestinal, reproductive, andcerebrospinal fluid analysis system. Such resources may further includepolymerase (PCR) chain reaction analysis systems, genetic markeranalysis systems, radioimmunoassay systems, chromatography and similarchemical analysis systems, receptor assay systems and combinations ofsuch systems. Histologic resources 68, somewhat similarly, may beincluded, such as tissue analysis systems, cytology and tissue typingsystems and so forth. Other histologic resources may includeimmunocytochemistry and histopathological analysis systems. Similarly,electron and other microscopy systems, in situ hybridization systems,and so forth may constitute the exemplary histologic resources.Pharmacokinetic resources 70 may include such systems as therapeuticdrug monitoring systems, receptor characterization and measurementsystems, and so forth.

[0070] In addition to the systems which directly or indirectly detectphysiological conditions and parameters, the controllable andprescribable resources may include financial sources 72, such asinsurance and payment resources, grant sources, and so forth which maybe useful in providing the high quality patient care and accounting forsuch care on an ongoing basis. Miscellaneous other resources 74 mayinclude a wide range of data collection systems which may be fully orsemi-automated to convert collected data into a useful digital form.Such resources may include physical examinations, medical history,psychiatric history, psychological history, behavioral pattern analysis,behavioral testing, demographic data, drug use data, food intake data,environmental factor information, gross pathology information, andvarious information from non-biologic models. Again, where suchinformation is collected manually directly from a patient or throughqualified clinicians and medical professionals, the data is digitized orotherwise entered into a useful digital form for storage and access bythe data processing system.

[0071] As discussed above with respect to FIG. 3, the multi-pointedarrow shown within the controllable and prescribable resources 40 inFIG. 4 is intended to represent that certain of these resources maycommunicate directly between and among themselves. Thus, imaging systemsmay draw information from other imaging systems, electrical resourcesmay interfaced with imaging systems for direct exchange of information(such as for timing or coordination of image data generation, and soforth). Again, while such data exchange may be thought of passingthrough the data processing system 10, direct exchange between thevarious controllable and prescribable resources may also be implemented.

[0072] As noted above, the data resources may generally be thought of asinformation repositories which are not acquired directly from a specificpatient. The controllable and prescribable resources, on the other hand,will typically include means for acquiring medical data from a patientthrough automated, semi-automated, or manual techniques. FIG. 5generally represents certain of the functional modules which may beconsidered as included in the various controllable and prescribableresource types illustrated in FIG. 4. As shown in FIG. 5, such resourcesmay be thought of as including certain general modules such as anacquisition module 76, a processing module 78, an analysis module 80, areport module 82, and an archive module 84. The nature of these variousmodules may differ widely, of course, depending upon the type ofresource under consideration. Thus, the acquisition module 76 mayinclude various types of electrical sensors, transducers, circuitry,imaging equipment, and so forth, used to acquire raw patient data. Theacquisition module 76 may also include more human-based systems, such asquestionnaires, surveys, forms, computerized and other input devices,and the like.

[0073] The nature and operation of the processing module 76, similarlywill depend upon the nature of the acquisition module and of the overallresource type. Processing modules may thus include data conditioning,filtering, and amplification or attenuation circuits. However, theprocessing modules may also include such applications as spreadsheets,data compilation software, and the like. In electrical and imagingsystems, the processing module may also include data enhancementcircuits and software used to perform image and other types of datascaling, reconstruction, and display.

[0074] Analysis module 80 may include a wide range of applications whichcan be partially or fully automated. In electrical and imaging systems,for example, the analysis module may permit users to enhance or alterthe display of data and reconstructed images. The analysis module mayalso permit some organization of clinician-collected data for evaluatingthe data or comparing the data to reference ranges, and the like. Thereport module 82 typically provides for an output or summary of theanalysis performed by module 80. Reports may also provide an indicationof techniques used to collect data, the number of data acquisitionsequences performed, the types of sequences performed, patientconditions during such data acquisition, and so forth. Finally, archivemodule 84 permits the raw, semi-processed, and processed data to bestored either locally at the acquisition system or- resource, or remotetherefrom, such as in a database, repository, archiving system (e.g.PACS), and so forth.

[0075] The typical modules included within the controllable andprescribable resources may be interfaced with programs, as indicated atreference numeral 22, to enhance the performance of various acquisition,processing and analysis functions. As illustrated diagrammatically inFIG. 5, for example, various computer-assisted acquisition routines 86may be available for analyzing previous acquisition sequences, and forprescribing, controlling or configuring subsequent data acquisition.Similarly, computer-assisted processing modules 88 may interface withthe processing module 78 to perform additional or enhance processing,depending upon previous processing and analysis of acquired data.Finally, programs such as computer-assisted data operating algorithms(CAX) modules 90 may be used to analyze received and processed data toprovide some indication of possible diagnoses that may be made from thedata.

[0076] While more will be said later in the present discussion regardingthe various types of controllable and prescribable resource types andmodalities, as well as of the modules used to aid in the acquisition,processing, analysis and diagnosis functions performed on the data fromsuch resources, it should be noted in FIG. 5 that various links betweenthese components and resources are available. Thus, in a typicalapplication, a computer-assisted acquisition module 86 may prescribe,control or configure subsequent acquisition of data, such as image data,based upon the results of enhanced processing performed by acomputer-assisted processing module 88. Similarly, such acquisitionprescription may result from output from a computer-assisted diagnosismodule 90, such as to refine potential diagnosis made, based uponsubsequent data acquisition. In a similar manner, a computer-assistedprocessing module 88 may command enhanced, different or subsequentprocessing by processing module 78 based upon output ofcomputer-assisted module 86 or of a computer-assisted diagnosis module90. The various modules, both of the resources, and of the programs,then, permit a high degree of cyclic and interwoven data acquisition,processing and analysis by virtue of the integration of these modulesinto the overall system in accordance with the present techniques.

[0077] As also illustrated in FIG. 5, for the typical controllable andprescribable resource, the programs executed on the data, and used toprovide enhanced acquisition, processing and analysis, may be driven bya logic engine 24 of the programs 22. As noted above, and as discussedin greater detail below, the logic engine 24 may incorporate a widerange of algorithms which link and integrate the output of programs,such as CAX algorithms, certain of which are noted as CAA, CAP and CADmodules 86, 88 and 90 FIG. 5, and which prescribe or control subsequentacquisition, processing and analysis based upon programmed correlations,recommendations, and so forth. As also noted above, the programs 22 areaccessed by and implemented via the computing resources 20. Thecomputing resources 20 may interface generally with the archive module84 of the particular resource modality via an appropriate interface 28as mentioned above. Finally, the computing resources 20 interface withthe integrated knowledge base 12. It should be noted from FIG. 5 thatthe knowledge base may also include modality-specific knowledge bases 19which are repositories of information relating to the specific modalityof the resource 62-74. Such modality-specific knowledge base data mayinclude factors such as system settings, preferred settings for specificpatients or populations, routines and protocols, data interpretationalgorithms based upon the specific modality, and so forth. The knowledgebases are generally available to clinicians 6 and, where desired, may bebased upon input from such clinicians. Thus, where appropriate, theknowledge base may be at least partially built by configuration inputfrom specialists, particularly inputs relating to the specific resourcemodality, for purposes of enhancing and improving acquisition,processing, analysis, or multiple aspects of these processes.

[0078] Modality/Type Interaction

[0079] A particularly powerful aspect of the present technique residesin the ability to integrate various resource data between types ofcontrollable and prescribable resources, between various modalities ofthese types, and between acquisition, processing and diagnosis made atvarious points in time. Such aspects of the present techniques aresummarized diagrammatically in FIGS. 6 and 7. FIG. 6 illustrates, in ablock form, a series of controllable and prescribable resource types 98,100 and 102. These resource types, which may generally track the variousdesignations illustrated in FIG. 4, and described above, may eachcomprise a series of modalities 104, 106 and 108. By way of example,type 98 may comprise various electrical resources denoted by referencenumeral 62 in FIG. 4, while another type of resource 100 may includeimaging resources 64 of FIG. 4. With each of these types the variousmodalities may include systems and procedures such as EEG, ECG, EMG, andso forth, for type 98, and X-ray, MRI, CT imaging systems, and so forth,for type 100.

[0080] In general, the representation of FIG. 6 illustrates that, inaccordance with the present technique, the patient may have variousprocedures performed at a first time 92, which may include one or arange of data acquisition, processing and diagnosis functions for anyone or more of the resource types 98, 100, 102, or any one or more orthe modalities within each type. Based upon the results of suchacquisition, processing and diagnosis, subsequent sessions of dataacquisition, processing or diagnosis may be performed at a subsequenttime 94. As indicated by the arrows between the blocks at these twopoints in time, control and prescription of subsequent data acquisition,processing and analysis may be appropriate. The subsequent operationsmay be performed on the same modality within a given resource type, oron a different modality of the same resource type. Similarly, the systemmay control or prescribe such procedures on entirely different types ofresources, and for specific modalities within the different types ofresources. Subsequent procedures may then be performed at subsequenttimes, as indicated generally by reference numeral 96 in FIG. 6.

[0081] As will be appreciated by those skilled in the art, the techniqueprovides a very powerful and highly integrated approach to control andprescription of medical data handling over time. For example, based uponthe results of acquisition and analysis of electrical data, such as attime 92, an additional session may be scheduled for the patient whereinthe system automatically or semi-automatically prescribes or controlsacquisition of images via specific imaging systems. The system may alsoprescribe or control acquisition, processing or analysis of clinicallaboratory data, histologic data, pharmacokinetic data, or othermiscellaneous data types as described generally above. Over time, andbetween the various modalities and resource types, then, and inconjunction with data from the other data resources discussed above, theanalysis may provide highly insightful feedback regarding medicalevents, medical conditions, disease states, treatments, predispositionsfor medical conditions and events, and so forth.

[0082] The integration of this information over time is furtherillustrated in FIG. 7. As shown in FIG. 7, the various data collected,processed and analyzed at the various points in time, and from thevarious resource types indicated by reference numerals 98, 100, 102, aremade available to and processed by the computing resources 20 via theprograms 22. As noted above, such processing may include a wide range ofoperations performed on available data, such as for analysis,prescription and control through the use of CAX algorithms, as noted forcertain such algorithms CAA 86, CAP 88, CAD 90, or other program modulesmade available to the computing resources 20. Other such modules may beprovided as part of an application, or software suite, or added overtime, as indicated generally at reference numeral 91. The logic enginecomponents 24 aid in correlating the data and in prescribing orcontrolling the subsequent acquisition, processing and analysis of datafrom one or more of the modalities of one or more of the resource types.Ultimately, the computing resources may make the information availableto the clinicians 6 as part of the integrated knowledge base 12.

[0083] Several points may be made with regards to the diagrammaticalrepresentations of FIG. 7. Firstly, the various interconnections betweenthe elements of the system will generally be provided by direct orindirect communications links as discussed above. Moreover,interconnections and data exchange between the various resource types98, 100 and 102 may be facilitated by direct interconnections betweenthe components as discussed above. This is the case both betweenmodalities of each type, as well as between various modalities ofdifferent types. The same is true for interconnections for data exchangebetween such types and modalities over time, as discussed above withrespect to FIG. 6. Finally, while clinicians 6 are illustrated atvarious positions in the overall diagrammatical representation of FIG.7, it should be noted that these may include the same or differentclinicians, depending upon the modalities and types employed, and theneeds of the patient. That is, specific clinicians or specialists may beprovided for various resource types and even specific modalities, withdifferent trained personnel being involved for other resource types andmodalities. Ultimately, however, the general reference to clinicians 6in the present context is intended to include all trained personnel thatmay, from time to time, and individually or as a team, provide inputsand care required by the medical situation.

[0084] The various types of controllable and prescribable resources, andthe modalities of such resource types may include any available dataresources which can be useful in performing the acquisition, processing,analysis functions offered by the present techniques. Specifically, thepresent technique contemplates that as few as a single resource may beprovided, such as for integration of acquisition, processing andanalysis over time, and, in a most useful configuration, a wide range ofsuch resources are made available. FIG. 8 is a tabulated summary ofcertain exemplary resource types, designated generally by referencenumeral 110, and modalities 112 within each of these types. As notedabove, such controllable and prescribable resources may generallyinclude electrical data sources, imaging data sources, clinicallaboratory data sources, histologic data sources, pharmacokinetic datasources, and other miscellaneous sources of medical data. While variousreference data on each of these types and modalities may be included inthe data resources, the types and modalities enumerated in the table ofFIG. 8 are designed to acquire data which is patient-specific and whichis acquired either directly or indirectly from a patient. The followingdiscussion relates to the various types and modalities summarized inFIG. 8 to provide a better understanding of the nature of such resourcesand the manner in which they may be used to evaluate medical events andconditions.

[0085] Electrical Data Resources

[0086] Electrical data resources of the controllable and prescribabletype may be considered as including certain typical modules orcomponents as indicated generally in FIG. 9. These components willinclude sensors or transducers 114 which may be placed on or about apatient to detect certain parameters of interest that may be indicativeof medical events or conditions. Thus, the sensors may detect electricalsignals emanating from the body or portions of the body, pressurecreated by certain types of movement (e.g. pulse, respiration), orparameters such as movement, reactions to stimuli, and so forth. Thesensors 114 may be placed on external regions of the body, but may alsoinclude placement within the body, such as through catheters, injectedor ingested means, capsules equipped with transmitters, and so forth.

[0087] The sensors generate signals or data representative of the sensedparameters. Such raw data are transmitted to a data acquisition module116. The data acquisition module may acquire sampled or analog data, andmay perform various initial operations on the data, such as filtering,multiplexing, and so forth. The data are then transmitted to a signalconditioning module 118 where further processing is performed, such asfor additional filtering, analog-to-digital conversion, and so forth. Aprocessing module 120 then receives the data and performs processingfunctions, which may include simple or detailed analysis of the data. Adisplay/user interface 122 permits the data to be manipulated, viewed,and output in a user-desired format, such as in traces on screendisplays, hardcopy, and so forth. The processing module 120 may alsomark or analyze the data for marking such that annotations, delimitingor labeling axes or arrows, and other indicia may appear on the outputproduced by interface 122. Finally, an archive module 124 serves tostore the data either locally within the resource, or remotely. Thearchive module may also permit reformatting or reconstruction of thedata, compression of the data, decompression of the data, and so forth.The particular configuration of the various modules and componentsillustrated in FIG. 9 will, of course, vary depending upon the nature ofthe resource and the modality involved. Finally, as representedgenerally at reference numeral 29, the modules and componentsillustrated in FIG. 9 may be directly or indirectly linked to externalsystems and resources via a network link.

[0088] The following is a more detailed discussion of certain electricaldata resources available for use in the present technique.

[0089] EEG

[0090] Electroencephalography (EEG) is a procedure, typically taking oneto two hours, that records the electrical activity of the brain viasensors or electrodes that are attached to a patient's head and coupledto a computer system. The process records the electrical discharge ofthe brain as sensed by the electrodes. The computer system displays thebrain electrical activity as traces or lines. Patterns that develop arerecorded and can be used to analyze brain activity. Several types ofbrainwaves may be identified in the patterns, including alpha, beta,delta and theta waves, each of which are associated with certaincharacteristics and activities. Variations from normal patterns of brainactivity can be indicative of certain brain abnormalities, medicalevents, conditions, disease states, and so forth.

[0091] In preparation for an EEG test, certain foods and medications aregenerally avoided as these can affect the brain activity and produceabnormal test results. The patient may also be asked to take necessarysteps to avoid low blood sugar (hypoglycemia) during the test, and maybe prepared to sleep if necessary as certain types of abnormal brainactivity must be monitored during sleep. Performance of an EEG may takeplace in a hospital or clinic and the examination is typically performedby an EEG technologist. The technologist secures the electrodes,typically 16-25, at various places on the patient's head, using paste orsmall needles to hold the electrodes in place. A physician, typically aneurologist, analyzes the EEG record. During the procedure, the patientmay be asked to simple relax, or various forms of stimulation may beintroduced, such as having the patient breath rapidly (hyperventilate)or view a strobe to observe the brain response to such stimuli. An EEGis typically performed to diagnose specific potential events orconditions, such as epilepsy, or to identify various types of seizuresthat a patient may experience in conjunction with such disorders. EEGexaminations may also be used to evaluate suspected brain tumors,inflammation, infection (such as encephalitis), or diseases of thebrain. The examinations may also be used to evaluate periods ofunconsciousness or dementia. The test may also evaluate the patient'sprognosis for recovery after cardiac arrest or other major trauma, toconfirm brain death of a comatose patient, to study sleep disorders, orto monitor brain activity while a person is receiving general anesthesiaduring surgery.

[0092] ECG

[0093] Electrocardiography (EKG, ECG) is a procedure, typicallyrequiring a 10-15 minute examination, that records electrical activityof the heart via electrodes attached to a patient's skin and coupled toa data acquisition system. The electrodes detect electrical impulses anddo not apply electricity to the body. The electrodes detect activity ofthe body's electrical system that result in cardiac activity. Theelectrical activity is detected, typically, through the skin on thechest, arms and legs of the patient where the electrodes are placed. Thepatient clothing may be removed above the waist and stockings or pantsmoved such that the patient's forearms and lower legs are exposed. Theexamination, typically performed by a specialized clinician, may bescheduled in a hospital, clinic or laboratory. After the test, acardiologist typically analyzes the electrocardiography record. Duringthe procedure, the patient is typically asked to lie on a bed or table,although other procedures require specific types of activities,including physical exertion. During the examination where appropriate,the patient may be asked to rest for a period of time before the test isperformed. The electrodes used to detect the electrical activity,typically 12 or more, are placed at the desired locations via adhesiveor other means. The areas may be cleaned and possibly shaven tofacilitate placement and holding of the electrodes. Additionally, aconductive pad or paste may be employed to improve the conduction of theelectrical impulses.

[0094] The acquisition system translates the electrical activity asindicated by the impulses, into traces or lines. The ECG traces willtypically follow characteristic patterns of the electrical impulsesgenerated by the heart. Various parts of the characteristic pattern maybe identified and measured, including portions of a waveform typicallyreferred to as the P-wave, the QRS complex, the ST segment and theT-wave. These traces may be analyzed by a computer or cardiologist forabnormalities which may be indicative of medical events or conditions.The ECG procedure is typically employed to identify such conditions asheart enlargement, signs of insufficient blood flow to the heart, signsof new or previous injury to the heart (e.g. resulting from heartattack), heart arrhythmias, changes in electrical activity of the heartcaused by a chemical imbalance in the body, signs of inflammation of thepericardium, and so forth.

[0095] EMG

[0096] Electromyography (EMG) is a procedure, typically taking from 1-3hours, designed to measure electrical discharges resulting fromcontraction of muscles. In general, as muscles contract, electricalsignals are generated which can be detected by sensors placed on apatient. EMG and nerve conduction studies, summarized below, can be usedto assist in the detection of the presence, location and existence ofconditions and diseases that can damage muscle tissue or nerves. EMGexaminations and nerve conduction studies are commonly performedtogether to provide more complete information.

[0097] In preparation for an EMG examination, a patient is typicallycalled upon to avoid certain medications and stimulants for a certaintime period, such as three hours, before the examination. Specificconditions such as bleeding or thinning of the blood, and practices suchas the use of a cardiac stimulator are noted prior to the examination.In the EMG examination itself, a clinician in a hospital or clinicscreens out extraneous electrical interference. A neurologist orphysical rehabilitation specialist may also perform the test, wheredesired. During the procedure, the patient is generally asked to take arelaxed position, and muscles subject to the test are positioned tofacilitate their access. Skin areas overlying the muscles to be testedare cleaned and electrodes are placed on the skin, including a referenceelectrode and a recording electrode. The reference electrode maytypically include a flat metal disk which is attached to the skin nearthe test area, or a needle inserted just below the skin near the testarea. The recording electrode typically comprises a needle, attached viaconducting wires to a data acquisition device or recorder. The recordingelectrode is inserted into the muscle tissue to be tested. Electricalactivity of the muscle is being tested is then recorded via the twoelectrodes both at rest and during contraction, typically with graduallyincreasing contraction force. Repositioning of the electrodes may berequired to record activity in different areas of the muscle or indifferent muscles. Electrical activity data thus gathered may bedisplayed and typically takes the form of spiked waveforms.

[0098] The results of EMG examinations may be analyzed alone, althoughthey typically are used in conjunction with other data to diagnoseconditions. Such other data may include the patient's medical history,information regarding specific symptoms, as well as information gatheredfrom other examinations. The EMG examination are typically performed toprovide assistance in diagnosing disease that can damage muscle tissue,nerves or junctions between nerve and muscle, or to evaluate the causesof weakness, paralysis or involuntary muscle stimulation. Suchexaminations can also be used to diagnose conditions such as post-poliosyndrome, as well as other conditions affecting normal muscle activity.

[0099] EIT

[0100] Electrical impedance tomography (EIT) is a non-invasive processdesigned to provide information regarding electrical parameters of thebody. Specifically, the process maps the electrical conductivity andpermittivity within the body. Electrical conductivity is a measure ofthe ease with which a material conducts electricity, while electricalpermittivity is a measure of the ease with which charges within amaterial will separate when an imposed electric field is introduced.Materials with high conductivity allow the passage of direct andalternating current. High permittivity materials, on the other hand,allow only the passage of alternating currents. Alternate data gatheringof electrical conductivity and permittivity within the body are obtainedin a typical examination, by applying current to the body via electrodesattached to the patient's skin and by measuring resulting voltages. Themeasurements permit computations of impedance of body tissues, which maybe used to create images of the tissues by reconstruction.

[0101] Because the electric current supplied during the examination willassume the path of least impedance, current flow through the tissueswill depend upon the conductivity distribution of the tissues of thepatient. Data obtained is then used to reconstruct images of thetissues, through various reconstruction techniques. In general, theimage reconstruction process comprises a non-linear mathematicalcomputation, and the resulting images can be used for various diagnosisand treatment purposes. For example, the process can be used to detectblood clots in the lungs or pulmonary emboli. The process can also beused to detect lung problems including collapsed lungs and accumulationof fluid. Other conditions which can be detected include internalbleeding, melanomas, cancers, such as breast cancer, as well as avariety of other medical events and conditions.

[0102] Nerve Conduction Tests

[0103] Nerve conduction studies have been used to measure how wellindividual nerves can transmit electrical signals. Both nerve conductionstudies and EMG studies can be used to aid in the detection and locationof diseases that can damage muscle tissue or nerves. Nerve conductionstudies and EMG are often done together to provide more completeinformation for diagnosis. Nerve conduction studies are typically donefirst if both tests are performed together.

[0104] In preparation for a nerve conduction study, a patient isgenerally asked to avoid medications, as well as stimulants such astobacco and caffeine. Additionally, issues with bleeding or bloodthinning, and the use of cardiac implants are identified prior to thetest. The nerve conduction study itself is generally performed by atechnologist and may take place in a hospital or clinic or in a specialroom designed to screen electrical interference. A neurologist orphysical rehabilitation specialist commonly performs the test. Duringthe procedure, the patient is asked to recline or sit and areas of thebody to be tested are relaxed. Several flat metal disk electrodes areattached to the patient's skin, and a charge-emitting electrode isplaced over a nerve to be tested. A recording electrode is placed overthe muscle controlled by the nerve. Electrical impulses are repeatedlyadministered to the nerve and the conduction velocity, or time requiredto obtain muscle response, is then recorded. A comparison of responsetimes may be made between corresponding muscles on different sides ofthe body. The nerve conduction study may be performed, as noted above,to detect and evaluate damage to the peripheral nervous system, toidentify causes of abnormal sensations, to diagnose post-polio syndrome,as well as to evaluate other symptoms.

[0105] ENG

[0106] Electronystagmography (ENG) refers to a series of tests designedto evaluate how well a patient maintains a sense of position and balancethrough coordinated inputs of the eyes, inner ears and brain. ENG testscan be utilized, for example, to determine whether dizziness or vertigoare caused by damage to nerve structures in the inner ear or brain. Thetests utilize electrodes which are attached to the facial area and arewired to a device for monitoring eye movements. During an ENG testseries, certain involuntary eye movements, referred to as nystagmus,which normally occur as the head is moved, are measured. Spontaneous orprolonged nystagmus may be indicative of certain conditions affectingthe nerves or structures of the inner ear or brain.

[0107] In preparation for an ENG test series, the patient is generallyasked to avoid certain medications, and stimulants for an extendedperiod. Visual and hearing aids, as well as facial cosmetics, may needto be avoided or removed due to possible interference with electrodesused during the tests. For the examination, a series of electrodes,typically five, are attached to the patient's face using a conductiveadhesive. The patient is tested in a seated position in a darkened room.During the examination, instrumentation is adjusted for measuring ormonitoring how a patient follows a moving point using only the eyes.Readings are then taken while the patient performs mental tasks with theeyes closed, gazes straight ahead and to each side, follows movement ofa pendulum or other object with the eyes, and moves the head and body todifferent positions. Additionally, eye movements may be monitored duringa caloric test, which involves warm or cool air or water being placed orblown inside the patient's ears. During such tests the electrodes detecteye movement and the monitoring system translates the movement into linerecordings. The caloric test may be performed with or without the use ofelectrodes to detect eye movement. The results of the test are analyzedto determine whether abnormal involuntary eye movements are detected,whether head movement results in vertigo, and whether eye movements havenormal intensity and direction during the caloric test. If such abnormalinvoluntary eye movements occur during the test, or if vertigo orabnormal eye movement is detected during the caloric test, results maybeindicative of possible brain or nerve damage, or damage to structures ofthe ear affecting balance.

[0108] Combinations

[0109] Various combinations of the foregoing procedures maybe used inconjunction to obtain more detail or specific information. Inparticular, as noted above, nerve conduction tests and EMG studies areoften done to compliment one another. However, based upon the results ofone or more of the electrical tests described above other, more detailedtests of the same nature or of different types may be in order. Theanalyses may be combined or considered separately to better identifypotential abnormalities, physical conditions, or disease states.

[0110] Imaging Data Resources

[0111] Various imaging resources may be available for diagnosing medicalevents and conditions in both soft and hard tissue, and for analyzingstructures and function of specific anatomies. Moreover, imaging systemsare available which can be used during surgical interventions, such asto assist in guiding surgical components through areas which aredifficult to access or impossible to visualize. FIG. 10 provides ageneral overview for exemplary imaging systems, and subsequent figuresoffer somewhat greater detail into the major system components ofspecific modality systems.

[0112] Referring to FIG. 10, an imaging system 126 generally includessome type of imager 128 which detects signals and converts the signalsto useful data. As described more fully below, the imager 128 mayoperate in accordance with various physical principles for creating theimage data. In general, however, image data indicative of regions ofinterest in a patient are created by the imager either in a conventionalsupport, such as photographic film, or in a digital medium.

[0113] The imager operates under the control of system control circuitry130. The system control circuitry may include a wide range of circuits,such as radiation source control circuits, timing circuits, circuits forcoordinating data acquisition in conjunction with patient or table ofmovements, circuits for controlling the position of radiation or othersources and of detectors, and so forth. The imager 128, followingacquisition of the image data or signals, may process the signals, suchas for conversion to digital values, and forwards the image data to dataacquisition circuitry 132. In the case of analog media, such asphotographic film, the data acquisition system may generally includesupports for the film, as well as equipment for developing the film andproducing hard copies that may be subsequently digitized. For digitalsystems, the data acquisition circuitry 132 may perform a wide range ofinitial processing functions, such as adjustment of digital dynamicranges, smoothing or sharpening of data, as well as compiling of datastreams and files, where desired. The data is then transferred to dataprocessing circuitry 134 where additional processing and analysis areperformed. For conventional media such as photographic film, the dataprocessing system may apply textual information to films, as well asattach certain notes or patient-identifying information. For the variousdigital imaging systems available, the data processing circuitry performsubstantial analyses of data, ordering of data, sharpening, smoothing,feature recognition, and so forth.

[0114] Ultimately, the image data is forwarded to some type of operatorinterface 136 for viewing and analysis. While operations may beperformed on the image data prior to viewing, the operator interface 136is at some point useful for viewing reconstructed images based upon theimage data collected. It should be noted that in the case ofphotographic film, images are typically posted on light boxes or similardisplays to permit radiologists and attending physicians to more easilyread and annotate image sequences. The images may also be stored inshort or long term storage devices, for the present purposes generallyconsidered to be included within the interface 136, such as picturearchiving communication systems. The image data can also be transferredto remote locations, such as via a network 29. It should also be notedthat, from a general standpoint, the operator interface 136 affordscontrol of the imaging system, typically through interface with thesystem control circuitry 130. Moreover, it should also be noted thatmore than a single operator interface 136 may be provided. Accordingly,an imaging scanner or station may include an interface which permitsregulation of the parameters involved in the image data acquisitionprocedure, whereas a different operator interface may be provided formanipulating, enhancing, and viewing resulting reconstructed images.

[0115] The following is a more detailed discussion of specific imagingmodalities based upon the overall system architecture outlined in FIG.10.

[0116] X-ray

[0117]FIG. 11 generally represents a digital X-ray system 150. It shouldbe noted that, while reference is made in FIG. 11 to a digital system,conventional X-ray systems may, of course, be provided as controllableand prescribable resources in the present technique. In particular,conventional X-ray systems may offer extremely useful tools both in theform of photographic film, and digitized image data extracted fromphotographic film, such as through the use of a digitizer.

[0118] System 140 illustrated in FIG. 11 includes a radiation source142, typically an X-ray tube, designed to emit a beam 144 of radiation.The radiation may be conditioned or adjusted, typically by adjustment ofparameters of the source 142, such as the type of target, the inputpower level, and the filter type. The resulting radiation beam 144 istypically directed through a collimator 146 which determines the extentand shape of the beam directed toward patient 4. A portion of thepatient 4 is placed in the path of beam 144, and the beam impacts adigital detector 148.

[0119] Detector 148, which typically includes a matrix of pixels,encodes intensities of radiation impacting various locations in thematrix. A scintillator converts the high energy X-ray radiation to lowerenergy photons which are detected by photodiodes within the detector.The X-ray radiation is attenuated by tissues within the patient, suchthat the pixels identify various levels of attenuation resulting invarious intensity levels which will form the basis for an ultimatereconstructed image.

[0120] Control circuitry and data acquisition circuitry are provided forregulating the image acquisition process and for detecting andprocessing the resulting signals. In particular, in the illustration ofFIG. 11, a source controller 150 is provided for regulating operation ofthe radiation source 142. Other control circuitry may, of course, beprovided for controllable aspects of the system, such as a tableposition, radiation source position, and so forth. Data acquisitioncircuitry 152 is coupled to the detector 148 and permits readout of thecharge on the photodetectors following an exposure. In general, chargeon the photodetectors is depleted by the impacting radiation, and thephotodetectors are recharged sequentially to measure the depletion. Thereadout circuitry may include circuitry for systematically reading rowsand columns of the photodetectors corresponding to the pixel locationsof the image matrix. The resulting signals are then digitized by thedata acquisition circuitry 152 and forwarded to data processingcircuitry 154.

[0121] The data processing circuitry 154 may perform a range ofoperations, including adjustment for offsets, gains, and the like in thedigital data, as well as various imaging enhancement functions. Theresulting data is then forwarded to an operator interface or storagedevice for short or long-term storage. The images reconstructed basedupon the data may be displayed on the operator interface, or may beforwarded to other locations, such as via a network 29 for viewing.Also, digital data may be used as the basis for exposure and printing ofreconstructed images on a conventional hard copy medium such asphotographic film.

[0122] MR

[0123]FIG. 12 represents a general diagrammatical representation of amagnetic resonance imaging system 156. The system includes a scanner 158in which a patient is positioned for acquisition of image data. Thescanner 158 generally includes a primary magnet for generating amagnetic field which influences gyromagnetic materials within thepatient's body. As the gyromagnetic material, typically water andmetabolites, attempts to align with the magnetic field, gradient coilsproduce additional magnetic fields which are orthogonally oriented withrespect to one another. The gradient fields effectively select a sliceof tissue through the patient for imaging, and encode the gyromagneticmaterials within the slice in accordance with phase and frequency oftheir rotation. A radio-frequency (RF) coil in the scanner generateshigh frequency pulses to excite the gyromagnetic material and, as thematerial attempts to realign itself with the magnetic fields, magneticresonance signals are emitted which are collected by the radio-frequencycoil.

[0124] The scanner 158 is coupled to gradient coil control circuitry 160and to RF coil control circuitry 162. The gradient coil controlcircuitry permits regulation of various pulse sequences which defineimaging or examination methodologies used to generate the image data.Pulse sequence descriptions implemented via the gradient coil controlcircuitry 160 are designed to image specific slices, anatomies, as wellas to permit specific imaging of moving tissue, such as blood, anddefusing materials. The pulse sequences may allow for imaging ofmultiple slices sequentially, such as for analysis of various organs orfeatures, as well as for three-dimensional image reconstruction. The RFcoil control circuitry 162 permits application of pulses to the RFexcitation coil, and serves to receive and partially process theresulting detected MR signals. It should also be noted that a range ofRF coil structures may be employed for specific anatomies and purposes.In addition, a single RF coil may be used for transmission of the RFpulses, with a different coil serving to receive the resulting signals.

[0125] The gradient and RF coil control circuitry function under thedirection of a system controller 164. The system controller implementspulse sequence descriptions which define the image data acquisitionprocess. The system controller will generally permit some amount ofadaptation or configuration of the examination sequence by means of anoperator interface 136.

[0126] Data processing circuitry 166 receives the detected MR signalsand processes the signals to obtain data for reconstruction. In general,the data processing circuitry 166 digitizes the received signals, andperforms a two-dimensional fast Fourier transform on the signals todecode specific locations in the selected slice from which the MRsignals originated. The resulting information provides an indication ofthe intensity of MR signals originating at various locations or volumeelements (voxels) in the slice. Each voxel may then be converted to apixel intensity in image data for reconstruction. The data processingcircuitry 166 may perform a wide range of other functions, such as forimage enhancement, dynamic range adjustment, intensity adjustments,smoothing, sharpening, and so forth. The resulting processed image datais typically forwarded to an operator interface for viewing, as well asto short or long-term storage. As in the case of foregoing imagingsystems, MR image data may be viewed locally at a scanner location, ormay be transmitted to remote locations both within an institution andremote from an institution such as via a network connection 29.

[0127] CT

[0128]FIG. 13 illustrates the basic components of a computed tomography(CT) imaging system. The CT imaging system 168 includes a radiationsource 170 which is configured to generate X-ray radiation in afan-shaped beam 172. A collimator 174 defines limits of the radiationbeam. The radiation beam 172 is directed toward a curved detector 176made up of an array of photodiodes and transistors which permit readoutof charges of the diodes depleted by impact of the radiation from thesource 170. The radiation source, the collimator and the detector aremounted on a rotating gantry 178 which enables them to be rapidlyrotated (such as at speeds of two rotations per second).

[0129] During an examination sequence, as the source and detector arerotated, a series of view frames are generated at angularly-displacedlocations around a patient 4 positioned within the gantry. A number ofview frames (e.g. between 500 and 1000) are collected for each rotation,and a number of rotations may be made, such as in a helical pattern asthe patient is slowly moved along the axial direction of the system. Foreach view frame, data is collected from-individual pixel locations ofthe detector to generate a large volume of discrete data. A sourcecontroller 180 regulates operation of the radiation source 170, while agantry/table controller 182 regulates rotation of the gantry and controlof movement of the patient.

[0130] Data collected by the detector is digitized and forwarded to adata acquisition circuitry 184. The data acquisition circuitry mayperform initial processing of the data, such as for generation of a datafile. The data file may incorporate other useful information, such asrelating to cardiac cycles, positions within the system at specifictimes, and so forth. Data processing circuitry 186 then receives thedata and performs a wide range of data manipulation and computations.

[0131] In general, data from the CT scanner can be reconstructed in arange of manners. For example, view frames for a full 360° of rotationmay be used to construct an image of a slice or slab through thepatient. However, because some of the information is typically redundant(imaging the same anatomies on opposite sides of a patient), reduceddata sets comprising information for view frames acquired over 180° plusthe angle of the radiation fan may be constructed. Alternatively,multi-sector reconstructions are utilized in which the same number ofview frames may be acquired from portions of multiple rotational cyclesaround the patient. Reconstruction of the data into useful images thenincludes computations of projections of radiation on the detector andidentification of relative attenuations of the data by specificlocations in the patient. The raw, the partially processed, and thefully processed data may be forwarded for post-processing, storage andimage reconstruction. The data may be available immediately to anoperator, such as at an operator interface 136, and may be transmittedremotely via a network connection 29.

[0132] PET

[0133]FIG. 14 illustrates certain basic components of a positronemission tomography (PET) imaging system. The PET imaging system 188includes a radio-labeling module 190 which is sometimes referred to as acyclotron. The cyclotron is adapted to prepare certain tagged orradio-labeled materials, such as glucose, with a radioactive substance.The radioactive substance is then injected into a patient 4 as indicatedat reference numeral 192. The patient is then placed in a PET scanner194. The scanner detects emissions from the tagged substance as itsradioactivity decays within the body of the patient. In particular,positrons, sometimes referred to as positive electrons, are emitted bythe material as the radioactive nuclide level decays. The positronstravel short distances and eventually combine with electrons resultingin emission of a pair of gamma rays. Photomultiplier-scintillatordetectors within the scanner detect the gamma rays and produce signalsbased upon the detected radiation.

[0134] The scanner 194 operates under the control of scanner controlcircuitry 196, itself regulated by an operator interface 136. In mostPET scans, the entire body of the patient is scanned, and signalsdetected from the gamma radiation are forwarded to data acquisitioncircuitry 198. The particular intensity and location of the radiationcan be identified by data processing circuitry 200, and reconstructedimages may be formulated and viewed on operator interface 136, or theraw or processed data may be stored for later image enhancement,analysis, and viewing. The images, or image data, may also betransmitted to remote locations via a network link 29.

[0135] PET scans are typically used to detect cancers and to examine theeffects of cancer therapy. The scans may also be used to determine bloodflow, such as to the heart, and may be used to evaluate signs ofcoronary artery disease. Combined with a myocardial metabolism study,PET scans may be used to differentiate non-functioning heart muscle fromheart muscle that would benefit from a procedure, such as angioplasty orcoronary artery bypass surgery, to establish adequate blood flow. PETscans of the brain may also be used to evaluate patients with memorydisorders of undetermined causes, to evaluate the potential for thepresence of brain tumors, and to analyze potential causes for seizuredisorders. In these various procedures, the PET image is generated basedupon the differential uptake of the tagged materials by different typesof tissue.

[0136] Fluorography

[0137] Fluoroscopic or fluorography systems consist of X-ray imageintensifiers coupled to photographic and video cameras. In digitalsystems, the basic fluoroscopic system may be essentially similar tothat described above with reference to FIG. 11. In simple systems, forexample, an image intensifier with a video camera may display images ona video monitor, while more complex systems might include highresolution photographic cameras for producing still images and camerasof different resolutions for producing dynamic images. Digital detectorssuch as those used on digital X-ray systems are also used in suchfluoroscopic systems. The collected data may be recorded for laterreconstruction into a moving picture-type display. Such techniques aresometimes referred to as cine-fluorography. Such procedures are widelyused in cardiac studies, such as to record movement of a living heart.Again, the studies may be performed for later reference, or may also beperformed during an actual real-time surgical intervention.

[0138] As in conventional X-ray systems, the camera used forfluorography systems receives a video signal which is collected by avideo monitor for immediate display. A video tape or disk recorder maybe used for storage and later playback. The computer system or dataprocessing circuitry may perform additional processing and analysis onthe image data both in real-time and subsequently.

[0139] The various techniques used in fluorography systems may bereferred to as video-fluoroscopy or screening, and digital fluorography.The latter technique is replacing many conventional photography-basedmethods and is sometimes referred to as digital spot imaging (DSI),digital cardiac imaging (DCI) and digital vascular imaging (DVI)/digitalsubtraction angiography (DSA), depending upon the particular clinicalapplication. A hard-copy device, such as a laser imager, is used for tooutput hard copies of digital images. Moreover, fluoroscopic techniquesmay be used in conjunction with conventional X-ray techniques,particularly where a digital X-ray detector is employed as describedabove. That is, high-energy X-ray images may be taken at intervalsinterspersed with fluoroscopic images, the X-ray images providing ahigher resolution or clarity in the images, while the fluoroscopicimages provide real-time movement views.

[0140] Mammography

[0141] Mammography generally refers to specific types of imaging,commonly using low-dose X-ray systems and high-contrast, high-resolutionfilm, or digital X-ray systems as described above, for examination ofthe breasts. Other mammography systems may employ CT imaging systems ofthe type described above, collecting sets of information which are usedto reconstruct useful images. A typical mammography unit includes asource of X-ray radiation, such as a conventional X-ray tube, which maybe adapted for various emission levels and filtration of radiation. AnX-ray film or digital detector is placed in an oppose location from theradiation source, and the breast is compressed by plates disposedbetween these components to enhance the coverage and to aid inlocalizing features or abnormalities detectable in the reconstructedimages. In general, the features of interest, which may include suchanatomical features as microcalcifications, various bodies and lesions,and so forth, are visible in the collected data or on the exposed filmdue to differential absorption or attenuation of the X-ray radiation ascompared to surrounding tissues. Mammography plays a central role in theearly detection of cancers which can be more successfully treated whendetected at very early stages.

[0142] Sonography

[0143] Sonography imaging techniques generally include ultrasonography,employing high-frequency sound waves rather than ionizing or other typesof radiation. The systems include a probe which is placed immediatelyadjacent to a patient's skin on which a gel is disposed to facilitatetransmission of the sound waves and reception of reflections.Reflections of the sound beam from tissue planes and structures withdiffering acoustic properties are detected and processed. Brightnesslevels in the resulting data are indicative of the intensity of thereflected sound waves.

[0144] Ultrasonography is generally performed in real-time with acontinuous display of the image on a video monitor. Freeze-frame imagesmay be captured, such as to document views displayed during thereal-time study. In ultrasound systems, as in conventional radiographysystems, the appearance of structures is highly dependent upon theircomposition. For example, water-filled structures (such as a cyst)appear dark in the resulting reconstructed images, while fat-containingstructures generally appear brighter. Calcifications, such asgallstones, appear bright and produce a characteristic shadowingartifact.

[0145] When interpreting ultrasound studies, radiologists and cliniciansgenerally use the terminology “echogeneity” to describe the brightnessof an object. A “hypoechoic” structure appears dark in the reconstructedimage, while a “hyperechoic” structure appears bright.

[0146] Ultrasonography presents certain advantages over other imagingtechniques, such as the absence of ionizing radiation, the high degreeof portability of the systems, and their relatively low cost. Inparticular, ultrasound examinations can be performed at a bedside or inan emergency department by use of a mobile system. The systems are alsoexcellent at distinguishing whether objects are solid or cystic. As withother imaging systems, results of ultrasonography may be viewedimmediately, or may be stored for later viewing, transmission to remotelocations, and analysis.

[0147] Infrared

[0148] Clinical thermography, otherwise known as infrared imaging, isbased upon a careful analysis of skin surface temperatures as areflection of normal or abnormal human physiology. The procedure iscommonly performed either by the direct application of liquid crystalplates to a part of the body, or via ultra-sensitive infrared camerasthrough a sophisticated computer interface. Each procedure extrapolatesthe thermal data and forms an image which may be evaluated for signs ofpossible disease or injury. Differences in the surface temperature ofthe body may be indicative of abnormally enhanced blood flow, forexample, resulting from injury or damage to underlying tissues.

[0149] Nuclear

[0150] Nuclear medicine involves the administration of small amounts ofradioactive substances and the subsequent recording of radiation emittedfrom the patient at specific loci where the substances accumulate. Thereare a wide variety of diagnostic and therapeutic applications of nuclearmedicine. In general, nuclear medicine is based upon the spontaneousemission of energy in the form of radiation from specific types ofnuclei. The radiation typically takes the form of alpha beta and gammarays. The nuclei are used in radiopharmaceuticals as tracers which canbe detected for imaging, or whose radiation can serve for treatmentpurposes.

[0151] A tracer is a substance that emits radiation and can beidentified when placed in the human body. Because the tracers can beabsorbed differently by different tissues, their emissions, once sensedand appropriately located in the body, can be used to image organs, andvarious internal tissues. Radiopharmaceuticals are typicallyadministered orally or intravenously, and tend to localize in specificorgans or tissues. Scanning instruments detect the radiation produced bythe radiopharmaceuticals and images can be reconstructed based upon thedetected signals. Radioactive analysis of biologic specimens may also beperformed by combining samples from the patient, such as blood or urine,with radioactive materials to measure various constituents of thesamples.

[0152] In treatment, radioactive materials may be employed due to theemissions they produce in specific tissues in which they are absorbed.Radioactive iodine, for example, may be trapped within cancerous tissuewithout excessive radiation to surrounding healthy tissue. Suchcompounds are used in various types of treatment, such as for thyroidcancer. Because the iodine tends to pass directly to the thyroid, smalldoses of radioactive iodine are absorbed in the gland for treatment ordiagnostic purposes. For diagnosis, a radiologists may determine whethertoo little or too much iodine is absorbed, providing an indication ofhypothyroidism or hyperthyroidism, respectively.

[0153] Other types of imaging in nuclear medicine may involve the use ofother compounds. Technetium, for example, is a radiopharmaceuticalsubstance which is combined with a patient's white blood cells, and maybe used to identify metastasis or spread of cancer in the bone.Following a period of settling, scans of specific limbs or of the entirebody may be performed to identify whether metastasis can be diagnosed.Technetium may also be used to identify abnormalities in the liver orgallbladder, such as blockages due to gallstones. The substances alsoused in radionuclide ventriculograms. In such procedures, a sample ofthe patient's blood is removed (such as approximately 10 cm³) andradioactive technetium is chemically attached to the red blood cells.The blood is then injected back into the patient, and its circulationthrough the heart is traced and imaged.

[0154] Other uses for technetium in nuclear medicine include thediagnosis of appendicitis, due to the inflammation which occurs and thepresence of white blood cells in the organ. Similarly, techniquesinvolving technetium may be used for the diagnosis of abdominalinflammations and infections.

[0155] In radiation oncology known or possible extents tumors may bedetermined, and radiation employed to attack tumorous cells whileavoiding major injury to surrounding healthy cells. External beamtherapy, for example, involves radiation from a linear accelerator,betatron or cobalt machine that is targeted to destroy cancers at knownlocations. In brachytherapy, radioactive sources such as iodine, cesiumor iridium are combined into or alongside a tumor. In another cancertherapy, known as boron neutron capture therapy (MNCT), alpha particlesare produced by non-radioactive pharmaceuticals containing boron.Subsequent neutron beam irradiation causes neutrons to react with theboron in a tumor to generate alpha particles that aide in destroying thetumor.

[0156] Radioactive nuclides can be naturally-occurring or may beproduced in reactors, cyclotrons, generators, and so forth. Forradiation therapy, oncology, or other applications in nuclear medicine,radiopharmaceuticals are artificially produced. The radiopharmaceuticalshave relatively short half-lives, such that they may be employed fortheir intended purpose, and degrade relatively rapidly to non-toxicsubstances.

[0157] Thermoacoustic

[0158] Thermoacoustic imaging systems are based upon application ofshort pulses of energy to specific tissues. The energy is created andapplied to cause portions of the energy to be absorbed by a patient'stissue. Due to heating of the tissue, the tissue is caused to expand andan acoustic wave is thereby generated. Multi-dimensional image data canbe obtained which is related to the energy absorption of the tissue. Theenergy may be applied in short pulses of radio-frequency (RF) waves. Theresulting thermoacoustic emissions are then detected with an array ofultrasonic detectors (transducers).

[0159] Thermoacoustic scanners consist generally of an imaging tank, amulti-channel amplifier and an RF generator. The generator and the othercomponents of the scanner are generally positioned in an RF-shieldedroom or environment. A digital acquisition system is provided along witha rotational motor for acquiring the thermoacoustic emission signals. Aprocessing system then filters the signals, and processes them indigital form for image reconstruction. In general, the image contrast isdetermined by the energy delivered to the patient, and image spatialresolution is determined by the sound propagation properties and thedetector geometry.

[0160] Clinical Laboratory Resources

[0161] Clinical laboratory resources include various techniques whichanalyze tissues of the body. Many of the resources are based uponextraction and analysis of fluids from different parts of the body, andcomparison of detectable parameters of the fluids with norms for theindividual patient or for a population of patients. The procedures forclinical laboratories analysis include sampling of the fluids ortissues, typically during a hospital or clinic visit. Such tissuecollection may include various sampling procedures, such as to collectblood, saliva, urine, cerebrospinal fluid (CSF), and so forth. Thetissues are collected and stored in specially prepared containers andforwarded to a laboratory for testing analysis.

[0162] Many different methods exist for performing clinical laboratorytests on body fluids and tissues. Some such techniques involve mixing ofantibodies or antigens with the tissues being tested. The antibodiesessentially consist of special proteins made by the immune system. Thebody produces such proteins in response to certain types of infection orthe presence of foreign materials or organisms in the body. Antigens aresubstances which cause immune system responses in the body. Suchantigens include bacteria, virus, medications, or other tissues,including, in certain circumstances, tissues of a patient's own body.

[0163] In general, where antibodies in the blood, for example, are to bedetected, antigens are typically used in tests and analysis. Where thepresence of antigens is to be detected, conversely, antibodies may beused. By way of example, analysis for the presence of lyme disease maybe based upon placement of portions of a bacteria that causes limedisease, the antigen, in a container along with samples of a patient'sblood. If antibodies against lyme disease bacteria a present, these willreact with antigen and may be detected in various ways. A positivereaction would indicate that the disease may be present, whereas anegative reaction indicates that the disease is probably not present.

[0164] Blood

[0165] A complete blood count (CBC) provides important informationregarding the types and numbers of cells in the blood. In general, theblood contains many components including red blood cells, white bloodcells and platelets. The CBC assists physicians in evaluating symptoms,such as weakness, fatigue, bruising and to diagnose specific diseasestates and medical events, such as anemia, infection and many othercommon disorders.

[0166] CBC and other blood tests may target specific parameters of theblood constituency. In particular, such tests may serve to identifywhite blood cell count, red blood cell count, hematocrit, hemoglobin,various red blood cell indices, platelet count, and other bloodchemistry measurements. The resulting indications, typically in the formof levels or ranges, are then compared to known normal or abnormallevels and ranges as an indication of health or potential diseasestates. Over time, the comparisons may be based upon the patient's ownnormal or abnormal levels as an indication of progression of disease orthe results of treatment or the bodies own reaction to infection orother medical events.

[0167] The specific types of measurements made in blood analysis may beindicative of wide range of medical conditions. For example, elevatedwhite blood count levels may be an indication of infection or the body'sresponse to certain types of treatment, such as cancer treatment. Thewhite blood cells may be differentiated from one another to identifymajor types of white blood cells, including neutrophils, lymphocytes,monocytes, eosinophils, and basophils. Each of these types of cellsplays a different role in response by the body. The numbers of each ofthese white blood cell types may provide important information into theimmune system and the immune response. Thus, levels and changes in thewhite blood cell counts can identify infection, allergic or toxicreactions, as well as other specific conditions.

[0168] Analysis of red blood cells serves numerous purposes. Forexample, because the red blood cells provide exchange of oxygen incarbon dioxide for tissues, their relative count may provide anindication of whether sufficient oxygen is being provided to the body,or, if elevated, whether there is a risk of polycythemia, a conditionthat can lead to clumping and blocking of capillaries. Hematocritmeasures the volume occupied by red blood cells in the blood. Thehematocrit value is generally provided as a percentage of the red bloodcells in a volume of blood. Hemoglobin tests measure the relative amountof hemoglobin in the blood, and provide indication of the blood'sability to carry oxygen throughout the body. Other red blood indicesinclude mean corpuscular volume, mean corpuscular hemoglobin, and meancorpuscular hemoglobin concentration. These indices are generallydetermined during other measurements of the CBC, and provide indicationsof the relative sizes of red blood cells, the hemoglobin content of thecells, and the concentration of hemoglobin in an average blood cell.Such measurements may be used, for example, to identify different typesof anemia.

[0169] The platelet or thrombocyte count provides an indication of therelative levels of platelets in the blood, and may be used to indicateabnormalities in blood clotting and bleeding.

[0170] In addition to the foregoing analyses, blood smear examinationsmay be performed, in which blood is smeared and dyed for manual orautomated visual inspection. The counts and types of cells contained inthe blood may ascertained from such examination, including theidentification of various abnormal cell types. Moreover, large varietyof chemical compositions may be detected and analyzed in blood tests,including levels of albumin, alkaline, phosphatase, ALT (SGPT), AST(SGOT), BUN, calcium-serum, serum chloride, carbon dioxide, creatinine,direct bilirubin, gamma-GT glucose, LDH, phosphorous-serum, potassium,serum sodium, total bilirubin, total cholesterol, total protein, uricacid, and so forth.

[0171] Blood testing is also used to identify the presence or changes inlevels of tumor biomarkers. For example, the presence of cancers such ascolon, prostate, and liver cancer are directly linked to elevated bloodlevels of specific biomarkers, such as carcinogenic embryonic antigen(CEA), prostate specific antigen (PSA), and alpha-fetoprotein (AFP),respectively, which can be detected by enzyme-linked immunosorbent assay(ELISA) tests, as discussed more fully below.

[0172] Urine

[0173] A wide variety of analysis may be performed on urine samples.Certain of these analyses based upon the overall appearance andcharacteristics of the sample, while others are based upon chemical ormicroscopic analysis. Of the analyses which are based on macroscopicfeatures of urine samples, are tests of color, clarity, odor, specificgravity, and pH.

[0174] Factors affecting color of urine samples include fluid balance,diet, medications, and disease states. Color may be, for example, anindication of the presence of blood in the urine, indicative ofconditions such as kidney ailments. The relative clarity (i.e. opacityor turbidity) of the urine may be an indication of the presence ofbacteria, blood, sperm, crystals or mucus that, in turn, may beindicative of abnormal physical conditions. Certain disease states orphysical conditions can also lead to abnormal odors which can bedetected in the blood, such as E.coli. The specific gravity of the urineprovides and indication of relative amounts of substances dissolved inthe sample. In general, higher specific gravities may be indicative ofhigher levels of solid materials dissolved in the urine, and may providean indication of the state of functioning of the kidneys. The pH of thesample (i.e. acidity and alkalinity) of the sample may be an indicationof kidney conditions and kidney function. For example, urine pH may beadjusted by treatment, such as to prevent formation of certain types ofkidney stones.

[0175] Chemical analyses of urine samples may be performed to provideindications of such constituents as proteins, glucose and ketones. Thepresence of proteins in the blood, can be an indication of certainphysical conditions and states, such as fever, normal pregnancy, as wellas diseases such as kidney disorders. Glucose, which is normally foundin the blood, is generally not present in the urine. The presence ofglucose in urine samples can be an indication of diabetes or certainkidney damage or disease. Ketones, a by-product of the metabolization offat, are normally present in the urine. However, high ketone levels cansignal conditions such as diabetic ketoacidosis. Other abnormalconditions, such as low sugar and starch diets, starvation, andprolonged vomiting can also cause elevated ketone levels in the urine.

[0176] Microscopic analysis of urine samples can be used to detect thepresence of a variety of materials, including red and white blood cells,casts, crystals, bacteria, yeast cells and parasites. Such solidmaterials are generally identified by placing the urine sample in acentrifuge to cause the materials to form sediments. Casts and crystalsmay be signs of abnormal kidney function, while the presence ofbacteria, yeast cells or parasites can indicate the presence of varioustypes of infection.

[0177] Saliva

[0178] Analyses of saliva can serve a number of clinical purposes. Forexample, sex hormone testing may be performed by different methodsincluding saliva and serum. The sex hormones typically tested includeestradiol, estrone, estriol, testosterone, progesterone, DHEA,melatonin, and cortisol. In using the saliva testing, the free fractionof hormones is calculated to arrive at a baseline value. Saliva reflectsthe biological active (free) fraction of steroids in the bloodstream(unlike blood or urine which measures total levels). The free fractionof hormones can easily pass from the blood into the salivary glands. Adrop in the free fraction of sex steroid hormones specifically leads toperimenopause and menopause. Such tests may be performed, for example,to determine whether hormone replacement therapy should be considered tobring hormone levels and balance from current levels back into theprotective range.

[0179] Saliva testing is also used to identify the presence or changesin levels of tumor biomarkers. For example, the presence of breastmalignancies in women is directly linked to elevated levels of c-erbB-2in saliva, which can be detected by enzyme-linked immunosorbent assay(ELISA) tests, as discussed more fully below.

[0180] Similarly, sputum-based tests can be used in the diagnosis ofdisease states, such as lung cancer. Such diagnosis is based upon thefact that cancer cells may be present in fluid a patient expels from theairways. In a typical implementation, clinicians analyze sputum samplesas a screening tool by determining whether the samples contain atypicalcells from the lungs before they develop into cancer cells.

[0181] Gastrointestinal Fluids

[0182] The analysis of gastrointestinal fluids can similarly beimportant in detecting and diagnosing certain disease states orabnormalities in function of various internal organs. For example, liverfunction tests (LFTs) afford detection of both primary and secondaryliver diseases, although the tests are generally not specific. That is,the results must be intelligently selected and interpreted to providethe maximum useful information. Indeed, certain of the common tests maybe characterized as functional tests rather than tests for diseases.

[0183] In one exemplary test, bilirubin is sampled and analyzed.Bilirubin results from breakdown of hemoglobin molecules by thereticuloendothelial system. Bilirubin is carried in plasma to the liver,where it is extracted by hepatic parenchymal cells, conjugated with twoglucuronide molecules to form bilirubin diglucuronide, and excreted inthe bile. Bilirubin can be measured in the serum as total bilirubin,including both conjugated and unconjugated bilirubin, and as directbilirubin which is conjugated bilirubin. Abnormal conditions, such ashemolysis can cause increased formation of unconjugated bilirubin, whichcan rise to levels that cannot be properly processed by the liver.Moreover, obstructive jaundice may result from extrahepatic common bileduct obstruction by stones or cancer, as evidenced by an increase inserum bilirubin. Long term obstruction may result in secondary liverdamage. Jaundice due to liver cell damage, such as is found in hepatitisor decompensated active cirrhosis, can also be evidenced by elevatedlevels of bilirubin.

[0184] As a further example, analysis of the enzyme alkaline phosphatasemay provide an indication of liver damage. The enzyme mainly produced inliver and bone, and is very sensitive to partial or mild degrees ofbiliary obstruction. In such circumstances, alkaline phosphatase levelsmay be elevated with a normal serum bilirubin. While little or noelevation may be present in mild cases of acute liver cell damage, incirrhosis, the alkaline phosphatase may vary depending upon the degreeof compensation and obstruction. Moreover, different isoenzymes ofalkaline phosphatase are found in liver and bone, which may be used toprovide an indication of the source of elevated serum alkalinephosphatase.

[0185] Aspartate aminotransferase (AST) is an enzyme found in severalorgans, especially in heart, skeletal muscle, and liver. Damage tohepatocytes releases AST, and in cases of acute hepatitis, AST levelsare usually elevated according to the severity and extent of hepatocytedamage at the particular time the specimen is drawn. In conditions suchas passive congestion of the liver, variable degrees of AST elevationmay be detected, especially if the episode is severe and acute.

[0186] Similarly, alanine aminotransferase (ALT) is an enzyme foundmostly, although not exclusively, in the liver. In liver disease, ALT iselevated in roughly the same circumstances as the AST, although ALTappears somewhat less sensitive to the concitoin, except with moreextensive or severe acute parenchymal damage. An advantage of ALTanalysis is that it is relatively specific for liver cell damage.

[0187] A number of other constituents of gastrointestinal fluids mayprovide similar indications of abnormal conditions and disease states.For example, lactate dehydrogenase, although somewhat less sensitivethan AST, may provide an indication of liver damage or hepatitis. Gammaglutamyl transpeptidase is another enzyme found primarily in the liverand kidney, and may be elevated in a wide variety of hepatic diseases.Serum proteins, such as albumin are synthesized chiefly in the liver,and acute or chronic destructive liver diseases of at least moderateseverity show decreased serum albumin on electrophoresis. Similarly,coagulation factors are synthesized in the liver, so that certaincoagulation tests (such as the prothrombin time or PT) are relativelysensitive indicators of hepatic function. Elevated levels of AMM(ammonia) may occur with liver dysfunction, hepatic failure,erythroblastosis fetalis, cor pulmonale, pulmonary emphysma, congestiveheart failure and exercise. Decreased levels may occur with renalfailure, essential or malignant hypertension or with the use of certainantibiotics (e.g. neomycin, tetracycline). Further, hepatitis-associatedantigen (HAA) may aid in the diagnosis of hepatitis A, B, non-A andnon-B, tracking recovery from hepatitis and to identify hepatitis“carriers.” Immunoglobulin G (IgG) level is used in the diagnosis andtreatment of immune deficiency states, protein-losing conditions, liverdisease, chronic infections, as well as specific diseases such asmultiple sclerosis, mumps, meningitis, while immunoglobulin M (IgM)levels are used in the diagnosis and treatment of immune deficiencystates, protein-losing conditions, Waldenstrom's Macroglobinema, chronicinfections and liver disease. Other constituents which may be analyzedinclude alkaline phosphatase, used, for example, to distinguish betweenliver and bone disease, and in the diagnosis and treatment ofparathyroid and intestinal diseases, leucine amiopeptidase, used todiagnose liver disorders, amylase, used to diagnose pancreatitis anddisorders affecting salivary glands, liver, intestines, kidney and thefemale genital tract, and lipase, used to diagnose pancreatitis andpancreatic carcinoma.

[0188] Reproductive Fluids

[0189] A number of tests may be performed on reproductive fluids toevaluate the function of the reproductive system, as well as diseasestates or abnormal function due to a wide variety of events andconditions including disease, trauma, and aging. Among the many testsavailable, are cervical mucus tests, designed to evaluate infertility bypredicting the day of ovulation and determining whether ovulationoccurs. Similarly, semen analyses are commonly performed to assess malefertility and document adequate sterilization after a vasectomy bychecking for abnormal volume, density, motility and morphology which canindicate infertility. The Papanicolaou smear test (commonly referred toas a Pap Smear, Pap Test, or Cytologic Test for Cancer) is used todetect neoplastic cells in cervical and vaginal secretions or to followcertain abnormalities (e.g. infertility).

[0190] Specific tests or analyses of reproductive fluids may be directedto corresponding specific disease states. For example, gonorrheacultures are used to diagnose gonorrhea, while chlamydia smears are usedto diagnose chlamydia infections, indicated if a gram stain of the smearexhibits polymorphonuclear leukocytes.

[0191] Cerebrospinal Fluids

[0192] Cerebrospinal fluids are the normally clear, colorless fluidsthat surround the brain and spinal cord. Cerebrospinal fluids aretypically analyzed to detect the presence of various infectiousorganisms. The fluid is generally collected by performing a lumbarpuncture, also called a spinal tap. In this procedure, a needle isinserted into the spinal canal to obtain a sample of the cerebrospinalfluid. The pressure of cerebrospinal fluid is measured during a lumbarpuncture. Samples are then collected and later analyzed for color, bloodcell counts, protein, glucose, and other substances. A sample of thefluid may be used for various cultures that promote the growth ofinfectious organisms, such as bacteria or fungi, to check for infection.

[0193] PCR

[0194] Polymerase chain reaction refers generally to a method ofdetecting and amplifying specific DNA or RNA sequences. Typically,certain known genetic regions are targeted in clinical applications,although a number of entire genomes have been and continue to besequences for research and clinical purposes. In general, particulargenes, which may be the root of abnormal conditions, disease states, orpredispositions for development of particular conditions, exhibit uniquesequences of constituent molecules. Moreover, infectious organisms,including viruses and bacteria, possess specific DNA or RNA sequencesthat are unique to the particular species or class of organism. Thesecan be detected by such targeted sequences.

[0195] The PCR technique is utilized to produce large amounts of aspecific nucleic acid sequence (DNA/RNA) in a series of simpletemperature-mediated enzymatic and molecular reactions. Beginning with asingle molecule of the genetic material, over a billion similar copiescan be synthesized. By testing for the presence or absence of the uniquesequence in a clinical specimen, PCR can be used for a great manypurposes, such as to diagnose certain viral infections. PCR has alsobeen used as one of the methods to quantify the amount of viral materialin a clinical specimen. The technique may also be used for forensicpurposes, for analyzing paternity and lineages, and so forth. Moreover,PCR assays are available for diagnostic, quantitative, and researchpurposes for a variety of viruses and viral diseases.

[0196] Gene Markers

[0197] As an outgrowth of genetic testing and genomic sequencing,increasing reference to gene markers has permitted very specificpredispositions to conditions and diseases to be evaluated. The HumanGenome Project has significantly advanced the understanding of thespecific genetic material and sequences making up the human genome,including an estimated 50,000 to 100,000 genes as well as the spacesbetween them. The resulting maps, once refined and considered inconjunction with data indicative of the function of individual andgroups of genes, may serve to evaluate both existing, past and possiblefuture conditions of a patient.

[0198] While several approaches exist for genetic mapping, in general,scientists first look for easily identifiable gene markers, includingknown DNA segments that are located near a gene associated with a knowndisease or condition, and consistently inherited by persons with thedisease but are not found in relatives who are disease free. Researchthen targets the exact location of the altered gene or genes andattempts to characterize the specific base changes. Maps of the genemarkers are then developed that depict the order in which genes andother DNA landmarks are found along the chromosomes.

[0199] Even before the exact location of a mutation is known, probes cansometimes be made for reliable gene markers. Such probes may consist ofa length of single-stranded DNA that is linked to a radioactive moleculeand matches an area near a gene of interest. The probe binds to thearea, and radioactive signals from the probe are then made visible onX-ray film, showing where the probe and the DNA match.

[0200] Predictive gene tests based upon probes and markers will becomeincreasingly important in diagnosis of gene-linked diseases andconditions. Predictive gene tests are already available for some twodozen disorders, including life-threatening diseases such as cysticfibrosis and Tay Sachs disease. Genes also have been found to be relatedto several types of cancer, and tests for several rare cancers arealready in clinical use. More recently, scientists have identified genemutations that are linked to an inherited tendency toward developingcommon cancers, including colon cancer and breast cancer. In general, itshould be noted that such gene markers and tests do not generallyguarantee that a future conditions may develop, but merely provide anindication (albeit perhaps strongly linked) that a particular sequenceor mutation exists.

[0201] Radioimmunoassay

[0202] Radioimmunoassays (RIA) is a technique used to detect smallamounts of antibodies (Abs) or antigens (Ags), and interactions orreactions between these. The Abs or Ags are labeled with a radioisotope,such as iodine-125, and the presence of the antibodies or antigens maythen be detected via a gamma counter. In a typical procedure, an Ab isbound to a hormone attached to a filter. A serum sample is added and anyhormone (Ag) is allowed time to bind to the Ab. To detect the binding, aradiolabeled hormone is added and allowed time to bind. All unboundsubstances are washed away. The amount of bound radio activity ismeasured in the gamma counter. Because the presence of the hormone inthe serum sample inhibits binding of the radiolabeled hormone, theamount of radio activity present in the test is inversely proportionalto the amount of hormone in the serum sample. A standard curve usingincreasing amounts of known concentrations of the hormone is used todetermine the quantity in the sample.

[0203] RIAs may be used to detect quite small quantities of Ag or Ab,and are therefore used to measure quantities of hormones or drugspresent in a patient's serum. RIAs may also be performed in solutionrather than on filters. In certain cases, RIAs are replaced byenzym-linked immunosorbent assays (ELISAs) or fluorescence polarizationimmunoassays (FPIAs). Such assays have similar sensitivities. FPIAs arehighly quantitative, and leases can be appropriately designed to besimilarly quantitative. RIAs can also be used to measure quantity ofserum IgE antibodies specific for various allergens, in which case theassays may be referred to as radioallergosorbent tests (RAST).

[0204] ELISAs employ enzymes to detect binding of Ag and Ab. The enzymeconverts a colorless substance called chromogen to a colored productindicating Ag/Ab binding. Preparation protocols may differ based uponwhether Abs or Ags are to be detected. In general, the combination of Agand Ab is attached to a surface, and a sample being tested is added andallowed to incubate. An antiglobulin or a second Ab that is covalentlyattached to an enzyme is added and allowed to incubate, and the unboundantiglobulins or enzyme-linked Abs are washed from the surface. Acolorless substrate of the enzyme is added and, if the enzyme-linkedsubstance is on the surface, the enzyme will be converted to a coloredproduct for detection.

[0205] Variations on the ELISA technique include competitive ELISA, inwhich Abs in a sample will bind to an Ag and then inhibit binding of anenzyme-linked Ab that reacts with the Ag, and quantitative ELISAs, inwhich intensities of color changes that are roughly proportional to thedegree of positivity of the sample are quantified.

[0206] Chromatography

[0207] Chromatography includes a broad range of techniques used toseparate or analyze complex mixtures by separating them into astationery phase bed and a mobile phase which percolates through thestationery bed. In such techniques, the components are past through achromatography device at different rates. The rates of migration overabsorptive materials provide the desired separation. In general, thesmaller the affinity a molecule has for the stationery phase, theshorter the time spent in a separation column.

[0208] Benefits of chromatography include the ability to separatecomplex mixtures with high degrees of precision, including separation ofvery similar components, such as proteins differing by single aminoacids. The techniques can thus be used to purify soluble or volatilesubstances, or for measurement purposes. Chromatography may also beemployed to separate delicate products due to the conditions under whichthe products are separated.

[0209] Chromatographic separation takes place within a chromatographycolumn, typically made of glass or metal. The column is formed of eithera packed bed or a tubular structure. A packed bed column containsparticles which make up the stationery phase. Open tubular columns maybe lined with a thin filmed stationery phase. The center of the columnis hollow. The mobile phase is typically a solvent moving through thecolumn which carries the mixture to be separated. The stationery phaseis typically a viscous liquid coded on the surface of solid particleswhich are packed into the column, although solid particles may also betaken as the stationery phase. Partitioning of solutes between thestationery and mobile phases renders the desired separations.

[0210] Several types of chromatography exist and may be employed formedical data collection purposes. In general, these types includeadsorption chromatography, partition chromatography, ion exchangechromatography, molecular exclusion chromatography and affinitychromatography.

[0211] Receptor Assays

[0212] Neurons transmit impulses based upon an electrical phenomenon inwhich the nerve fibers are sequentially polarized and depolarized. Ingeneral, a potential across a cell boundary, typically of approximately80 mv, results from concentrations of potassium ions within the neuronand sodium ions external to the neuron. When a stimulus is applied tothe cells, a change in potential results, resulting in a flow of ions indepolarization. Neurotransmitters then cross the synaptic cleft andpropagate the neural impulse.

[0213] Assays have been designed to determine the presence or absence ofsubstances, including neurotransmitters, toxins, and so forth, which canprovoke the nerve response. In general, such assays are used to measurethe presence of chemicals which provoke responses of particularinterest. By way of example, domoic acid receptor binding assays can beused to identify substances which bind to a glutamate receptor in thebrain.

[0214] In the case of the domoic acid receptor binding assay, forexample, a cainic acid preparation is made that includes a radioactivemarker, such as ³H. By allowing the radioactive cainic acid to attach tocells containing glutamate receptors, radioactivity present in cellswhich may bind the cainic acid (which functions in a manner similar toglutamic acid (a common amino acid neurotransmitter) as well as domoicacid can be measured. In practice, a standard curve is typicallygenerated based upon addition of a known amount of domoic acid to thecells, and this standard curve is then employed to estimate theconcentrations of the assayed substance in a prepared sample.

[0215] Histologic Data Resources

[0216] Tissue Analysis

[0217] Histology is the microscopic study of the structure and behaviorof tissue. It is classified into two categories based on the livingstate of the specimen under study: non-living and living specimens. Thefirst category is the traditional study of a non-living specimen. Manydifferent methods may be used in preparing a specimen for study, usuallydictated by the type of tissue being studied. Some common preparationmethods are: a thinly sliced section on a glass slide or metal grid, asmear on a glass slide; a sheet of tissue stretched thinly; and fibersthat have been separated from a strand. Some common specimen types onwhich these methods are used include tissue of an organ, blood, urine,mucus, areolar connective tissue, and muscle.

[0218] Most of the preparation methods for non-living specimens arefairly straightforward, while the actual method used to prepare asection can be quite involved. The specimen must first be preserved toprevent decay, preserve the cellular structure, and intensify laterstaining. The specimen is generally either be frozen or imbedded in waxor plastic so that it will cut properly. A section of interest is cut,typically to a thickness dictated by the viewing means, such as 1-150microns for light microscopy or 30-60 nanometers for electronmicroscopy. The section is mounted on a glass slide or metal grid. Thesection is then generally stained, possibly in several stages bychemical dyes, or reagents. If the specimen is to be viewed under anoptical microscope, excess water and dye will then be removed and thespecimen on the slide will be covered by a glass slip. Finally, thespecimen will be observed, analyzed, and observed data are recorded.

[0219] Specimen types and methods of study for living specimens areseriously limited by the requirement to keep the specimen alive. Ingeneral, specimens may be viewed in vivo or in vitro. A typical in vitrospecimen is a tissue culture system. A typical in vivo specimen mustalso be available in an observable situation, i.e. ear or skin tissue.Because staining and other methods of preparation are inappropriate,specialized phase-contrast or dark-field microscopy are typically usedto provide enhanced contrast between the natural structures.

[0220] Cytology

[0221] Cytology is the study of the structure, function, pathology, andlife history of cells. The advantages of cytology, as compared to otherhistological data collection techniques, include the speed with which itcan be performed, its relatively low cost, and the fact that it can leadto a specific diagnosis. Disadvantages include the relatively smallsample sizes generally observed, the lack of information regardingtissue architecture, and the relatively high level of skill required ofclinicians performing the studies. The specimen collection method usedgenerally depends upon the type of specimen to be collected. Suchmethods include fine needle aspiration, solid tissue impression smearsor scrapings, and fluid smears. Aspiration is essentially specimencollection by suction. Some common specimen types collected by thesevarious methods include thyroid, breast, or prostrate specimens, uterus,cervix or stomach tissues, and excretions (urine or feces) or secretions(sputum, prostatic fluid or vaginal fluid).

[0222] The specimen preparation method for cytology is relativelystraightforward. The sample is first removed from the area beingexamined, is then placed on a glass slide, stained, and studied. Whenthe sample is a solid, an additional step may be appropriate, calledsquash preparation. In this procedure the sample is placed on a firstglass slide, squashed with a second glass slide, and then spread acrossthe first glass slide using the second slide.

[0223] Analysis of a cytologic specimen typically includes comparison ofthe specimen to normal cells for the anatomic location of the sample.The cells are then classified as normal or abnormal. Abnormality istypically determined by the presence of inflammation, hyperplasia, orneoplasia. Hyperplasia is an increase in size of a tissue or organ dueto the formation of more cells, independent of the natural growth of thebody. Neoplasia is the formation of an abnormal growth, i.e. a tumor.Abnormal cells may be sub-classified as inflammatory ornon-inflammatory, and the type of inflammatory cells that predominate isdetermined. Inflammation may be determined by a high, or greater thannormal, presence of leukocytes or macrophages. Leukocytes are classifiedby their physical appearance into two groups: granular or nongranular.Examples of granular leukocytes are neutrophils and eosinophils.Nongranular leukocytes include lymphocytes. If the specimen cells arenon-inflammatory, they are then checked for malignancy. If the cells aremalignant, type of malignant tissue is determined.

[0224] Tissue Typing

[0225] Tissue typing is the identification of a patient's humanleukocyte antigen (HLA) pattern. The HLA pattern is located on a regionof chromosome 6, called the major histocompatibility complex (MHC). TheHLA system is crucial to fighting infections because it distinguishesbetween foreign and native cells for the body's immune system. Thus,this pattern is also crucial for the organ transplant field, because ifthe donor's and donee's HLA patterns are not similar enough, the donee'simmune system will attack (“reject”) the transplanted organ or tissue.There are five groups, called loci, of antigens that make up the HLApattern: HLA-A, HLA-B, HLA-C, HLA-D, and HLA-DR. Each locus of antigenscontains many variations, called alleles, identified, if known, with anumber, i.e. HLA-A2. Provisionally identified alleles are designatedwith a letter and number, i.e. HLA-Cw5. Each person inherits an alleleof each locus from a parent. Thus, the chance of two siblings havingidentical HLA patterns is 25%. The closer the relation between twopeople, the greater the similarity will be in their two respective HLApatterns. Thus, tissue typing has been used to determine the likelihoodthat two people are related. Also, patients with certain HLA patternsare more prone to certain diseases; however, the cause of thisphenomenon is unknown. All that is typically needed to perform thetissue typing test is a blood sample.

[0226] Two common methods for testing for the tissue type includeserology and DNA testing. Until recently, only serology tests wereperformed. However, since the amino acid sequences of the alleles of theHLA-A, B, Cw, and DR loci have been determined, DNA testing has becomethe most widely used testing method for these loci of the HLA pattern.The serology test is generally performed by incubating lymphocytes froma blood sample in a dish containing an antiserum that will destroy, orlyse, a certain allele. A dye is then added to show whether any lysedcells are present. If so, the test is positive for that specific allele.

[0227] Immunocytochemistry

[0228] Cytochemistry is the study of the chemical constituents oftissues and cells involving the identification and localization of thedifferent chemical compounds and their activities within the cell.Immunocytochemistry comprises a number of methods, where antibodies areemployed to localize antigens in tissues or cells for microscopicexamination. There are several strategies to visualize the antibody.

[0229] For transmitted light microscopy, color development substratesfor enzymes are often used. The antibody can be directly labeled withthe enzyme. However, such a covalent link between an antibody and anenzyme might result in a loss of both enzyme and antibody activity. Forsuch reasons several multistep staining procedures have been developed,where intermediate link antibodies are used.

[0230] Stereology is a quantitative technique providing the necessarymathematical background to predict the probability of an encounterbetween a randomly positioned, regularly arranged geometrical probe andthe structure of interest. Stereological methods have been introduced inquantitative immunocytochemistry. Briefly, a camera may be mounted on amicroscope with a high precision motorized specimen stage and amicrocator to monitor movements. The camera is coupled to a computerconfigured to execute stereological software. The analysis is performedat high magnification using an objective with a high numerical aperture,which allows the tissue to be optically dissected in thin slices, suchas to a thickness of 0.5 μm. Quantitative analysis requires thicksections (40 μm) with an even and good penetration of theimmunohistochemical staining.

[0231] Electron microscopy is also commonly used in immunocytochemistry.In a typical sample preparation method the sample is first preserved. Inone assembly type, the specimen is embedded in an epoxy resin. Severalsamples are then assembled into a laminar assembly, called a stack,which facilitates simultaneous sectioning of multiple samples. Anotherassembly type, called a mosaic, can be used when the stack assembly isinfeasible. The mosaic assembly involves placing several samplesside-by-side and then imbedding them in an epoxy resin. After the stackor mosaic is assembled, it is then sectioned and examined.

[0232] Histopathological Analysis

[0233] Histopathological analysis involve in making diagnoses byexamination of tissues both with the naked eye and the microscope.Histopathology is classified into three main areas: surgical pathology,cytology, and autopsy. Surgical pathology is the examination of biopsiesand resected specimens. Cytology comprises both a major part ofscreening programs (e.g. breast cancer screening and cervical cytologyprograms), and the investigation of patients with symptomatic lesions(e.g. breast lumps or head and neck lumps).

[0234] Electron Microscopy

[0235] Electron Microscopes are scientific instruments that use a beamof highly energetic electrons to examine objects on a very fine scale.There are two common types of electron microscopes: transmission andscanning. Further, specimen sections must be viewed in a vacuum andsliced very thinly, so that they will be transparent to the electronbeam.

[0236] Two main indicators are used in microscopy: magnification andresolution. Magnification is the ratio of the apparent size of thespecimen (as viewed) to the actual size. Electron microscopes allowmagnification of a specimen up to 200 times greater than that of anoptical microscope. Resolution measures the smallest distance betweentwo objects at which they can still be distinguished. The resolution ofan electron microscope is roughly 0.002 μm, up to 100 times greater thanthat of an optical microscope.

[0237] The examination of a specimen by an electron microscope can yielduseful information on a specimen, such as topography, morphology,composition, and crystallographic information. The topography of aspecimen refers to the surface features of an object. There is generallya direct relation between these features and the material properties(hardness, reflectivity, and so forth) of the specimen. The morphologyof a specimen is the shape and size of the particles making up thespecimen. The structures of the specimen's particles are generallyrelated to its material properties (ductility, strength, reactivity, andso forth). The composition comprises the elements and compoundscomprising a specimen, and the relative amounts of these. Thecomposition of the specimen is generally indicating of its materialproperties (melting point, reactivity, hardness, and so forth). Thecrystallographic information relates to the atomic arrangement of thespecimen. The specimen's atomic arrangement is also related to itsmaterial properties (conductivity, electrical properties, strength, andso forth).

[0238] In situ Hybridization

[0239] In situ hybridization (ISH) is the use of a DNA or RNA probe todetect the presence of the complementary DNA sequence in clonedbacterial or cultured eukaryotic cells. Eukaryotic cells are cellshaving a membrane-bound, structurally discrete nucleus, and other welldeveloped subcellular compartments. Eukaryotes include all organismsexcept viruses, bacteria, and bluegreen algae. There are two commontypes of ISH: fluorescence (FISH) and enzyme-based.

[0240] ISH techniques allow specific nucleic acid sequences to bedetected in morphologically preserved chromosomes, cells or tissuesections. In combination with immunocytochemistry, in situ hybridizationcan relate microscopic topological information to gene activity at theDNA, mRNA, and protein level. Moreover, preparing nucleic acid probeswith a stable nonradioactive label can remove major obstacles whichhinder the general application of ISH. Furthermore, this may open newopportunities for combining different labels in one experiment. The manysensitive antibody detection systems available for such probes furtherenhances the flexibility of this method.

[0241] Several different fluorescent or enzyme-based systems are usedfor detecting labeled nucleic acid probes. Such options provide theresearcher with flexibility in optimizing experimental systems toachieve highest sensitivity, to avoid potential problems such asendogenous biotin or enzyme activity, or to introduce multiple labels ina single experiment. Such factors as tissue fixation, endogenous biotinor enzyme activity, desired sensitivity, and permanency of record areall considered when choosing both the optimal probe label and subsequentdetection system.

[0242] Combinations

[0243] Any combination in whole or in part of the above methods can beused to optimally diagnose a patient's malady or, more generally, aphysical condition, or risk or predisposition for a condition.

[0244] Pharamcokinetic Data Resources

[0245] Therapeutic Drug Monitoring

[0246] Therapeutic drug monitoring (TDM) is the measurement of the serumlevel of a drug and the coordination of this serum level with a serumtherapeutic range. The serum therapeutic range is the concentrationrange where the drug has been shown to be efficacious without causingtoxic effects in most people. Recommended therapeutic ranges cangenerally be found in commercial and academic pharmaceutical literature.

[0247] Samples for TDM must be obtained at the proper elapsed time aftera dose for valid interpretation of results to avoid errors. Therapeuticranges are established based on steady state concentrations of a drug,generally achieved about five half-lives after oral dosing has begun. Insome instances, it may be useful to draw peak and trough levels. Peaklevels are achieved at the point of maximum drug absorption. Troughlevels are achieved just before the next dose. The type of sample usedfor TDM is also important. For most drugs, therapeutic ranges arereported for serum concentrations. Some TDM test methods may becertified for use with both serum and plasma. Manufactures generallyindicate which samples are acceptable.

[0248] A number of drugs can be subject to TDM. For example, commonanticonvulsant drugs which require therapeutic monitoring includephenytoin, carbamazepine, valproic acid, primidone, and phenobarbital.Anticonvulsant drugs are usually measured by immunoassay. Immunoassaysare generally free from interferences and require very small samplevolumes.

[0249] As a further example, the cardioactive drug digoxin is acandidate for therapeutic monitoring. The bioavailability of differentoral digoxin preparations is highly variable. Digoxin pharmacokineticsfollow a two-compartment model, with the kidneys being the major routeof elimination. Patients with renal disease or changing renal functionare typically monitored, since their elimination half life will change.The therapeutic range for digoxin is based on blood samples obtained apredetermined amount of time, such as eight hours, after the last dosein patients with normal renal function. Particular periods may also bespecified as a basis for determining steady state levels before thesamples are drawn. Immunoassays, typically available in kits, indicatesignificant interferences or cross-reactivities for the tests.

[0250] As a further example, theophylline is a bronchodilator withhighly variable inter-individual pharmacokinetics. Serum levels are bemonitored after achievement of steady-state concentrations to insuremaximum therapeutic efficacy and to avoid toxicity. Trough levels areusually measured, with immunoassays being the most common method usedfor monitoring this drug. Similarly, for lithium compounds used to treatbipolar depressive disorders, serum lithium concentrations are measuredby ion selective electrode technology. An ion selective electrode has amembrane which allows passage of the ion of interest but not other ions.A pH meter is an example of an ion selective electrode which responds tohydrogen ion concentrations. A lithium electrode will respond to lithiumconcentrations but not to other small cations such as potassium.

[0251] As yet a further example, tricyclic antidepressant drugs includeimipramine, its pharmacologically active metabolite desipramine;amitriptyline and its metabolite nortriptyline, as well as doxepin andits metabolite nordoxepin. Both the parent drugs and the metabolites areavailable as pharmaceuticals. These drugs are primarily used to treatbipolar depressive disorders. Imipramine may also be used to treatenuresis in children, and severe attention deficit hyperactivitydisorder that is refractory to methylphenidate. Potential cardiotoxicityis the major reason to monitor these drug levels. Immunoassay methodsare available for measuring imipramine and the other tricyclics, buthigh performance liquid chromatography (HPLC) methods are generallypreferred. When measuring tricyclic antidepressants which havepharmacologically active metabolites, the parent drug and the metaboliteare generally measured.

[0252] Receptor Characterization and Measurement

[0253] Receptor characterizations are traditionally performed using oneof several methods. These methods include direct radioligand bindingassays, radioreceptor assays, and agonist and antagonist interactions,both complete and partial. A radioligand is a radioactively labeled drugthat can associate with a receptor, transporter, enzyme or any proteinof interest. Measuring the rate and extent of binding providesinformation on the number of binding sights and their affinity andpharmacological characteristics.

[0254] Three commonly used experimental protocols include saturationbinding experiments, kinetic experiments, and competitive bindingexperiments. Saturation binding protocols measure the extend of bindingin the presence of different concentrations of the radioligand. From ananalysis of the relationship between binding and ligand concentration,parameters, including the number of binding sites, binding affinity, andso forth can be determined. In kinetic protocols, saturation andcompetitive experiments are allowed to incubate until binding hasreached equilibrium. Kinetic protocols measure the time course ofbinding and dissociation to determine the rate constants of radioligandbinding and dissociation. Together, these values also permit calculationof the KD. In competitive binding protocols, the binding of a singleconcentration of radioligand at various concentrations of an unlabeledcompetitor are measured. Such protocols permit measurement of theaffinity of the receptor for the competitor.

[0255] Due to expense and technical difficulty, direct radioligandbinding assays are often replaced with competitive binding assays. Thelatter technique also permits radiolabeling of drugs to promote anunderstanding of their receptor properties. Techniques for drug designand development, based upon combinatorial chemistry often employradioreceptor assays. Radioreceptor assay techniques are based upon thefact that the binding of a ligand having high affinity for amacromolecular target may be measured without the need for equilibriumdialysis, as long as the ligand-receptor complex can be separated fromthe free ligand. By labeling the ligands with appropriate radioactivesubstances, the ligand-receptor combination can be measured. Such assaysare both rapid and highly sensitive. Antagonism is the process ofinhibiting or preventing an agonist-induced receptor response. Agentsthat produce such affects are referred to as antagonists. Theavailability of selective antagonists has provided an important elementfor competitive binding protocols.

[0256] Miscellaneous Resources

[0257] Physical Exam

[0258] A comprehensive physical examination provides an opportunity fora healthcare professional to obtain baseline information about thepatient for future use. The examination, which typically occurs in aclinical setting, provides an opportunity to collect information onpatient history, and to provide information on diagnoses, and healthpractices. Physical examinations may be complete, that is cover many orvirtually all of the body, or may be specific to symptoms experienced bya patient.

[0259] In a typical physical examination, the examiner observes thepatient's appearance, general health, behavior, and makes certain keymeasurements. The measurements typically include height, weight, vitalsigns (e.g. pulse, breathing rate, body temperature and blood pressure).This information is then recorded, typically on paper for a patient'sfile. In accordance with aspects of the present technique, much of theinformation can be digitized for inclusion as a resource for compilingthe integrated knowledge base and for providing improved care to thepatient. Exemplary patient data acquisition techniques and theirassociation with the knowledge base and other resources will bediscussed in greater detail below.

[0260] In a comprehensive physical examination, the various systems ofthe patient's body will generally be examined, such as in a sittingposition. These include exposed skin areas, where the size and shape ofany observable lesions will be noted. The head is then examined,including the hair, scalp, skull and face areas. The eyes are observedincluding external structures and internal structures via anophthalmoscope. The ears are similarly examined, including externalstructures and internal structures via an otoscope. The nose and sinusesare examined, including the external nose structures and the nasalmucosa and internal structures via a nasal speculum. Similarly, themouth and pharynx are examined, including the lips, gums, teeth, roof ofthe mouth, tongue and throat. Subsequently, the neck and back aretypically examined, including the lymph nodes on either side of theneck, and the thyroid gland. For the back, the spine and muscles of theback are generally palpated and checked for tenderness, the upper backbeing palpated on right and left sides. The patient's breathing is alsostudied and noted. The breasts and armpits are then examined, includingexamination of a woman's breasts with the arms in relaxed and raisedpositions for signs of lesions. For both men and women, lymph nodes ofthe armpits are examined, as are the movements of the joints of thehand, arms, shoulder, neck and jaw.

[0261] Subsequently, generally with the patient lying, the breasts arepalpated and inspected for lumps. The front of the chest and lungs areinspected using palpation and percussion, with the internal breathsounds being again noted. The heart rate and rhythm is then checked viaa stethoscope, and the blood vessels of the neck are observed andpalpated.

[0262] The lower body is also examined, including by light and deeppalpation of the abdomen for examination of the internal organsincluding the liver, spleen, kidneys and aorta. The rectum and anus maybe examined via digital examination, and the prostate gland may bepalpated. Reproductive organs are inspected and the area is examined forhernias. In men, the scrotum is palpated, while in women the pelvicexamination is typically performed using a speculum and a Pap test. Thelegs are inspected for swelling and pulses in the knee, thigh and footarea are found. The groin area is palpated for the presence of lymphnodes, and the joints and muscles are also observed. The musculoskeletalsystem is also examined, such as for noting the straightness of thespine and the alignment of the legs and feet. The blood vessels are alsoobserved for abnormally enlarged veins, typically occurring in the legs.

[0263] A typical physical examiner also includes evaluation of thepatients alertness and mental ability. The nervous system may also beexamined via neurologic screening, such as by having the patient performsimple physical operations such as steps or hops, and the reflexes ofthe knees and feet can be tested. Certain reflex functions, such as ofthe eye, face, muscles of the jaw, and so forth may also be noted, asmay the general muscle tone and coordination.

[0264] Medical History

[0265] Medical history information is generally collected onquestionnaires that are completed upon entry of the patient to a medicalfacility. As noted below, and in accordance with aspects of the presenttechnique, such information may be digitized in advance of a patientvisit, and follow-up information may be acquired, also in advance, orduring a patient visit. The information may typically include datarelating to an insurance carrier, and names and addresses or phonenumbers of significant or recent practitioners who have seen or caredfor the patient, including primary care physicians, specialists, and soforth. Present medical conditions are generally of interest, includingsymptoms and disease states or events being experienced by the patient.Particular interests are conditions such as diabetes, high bloodpressure, chronic or acute diseases and illnesses, and so forth. Currentmedications are also noted, including names, doses, when taken, theprescribing physician name, side effects, and so forth. Finally, currentallergies, known to the patient, are noted, including allergies tonatural and man-made substances.

[0266] Medical history information also includes past medical history,even medical information extending into the patient's childhood,immunization records, pregnancies, significant short-term illnesses,longer term conditions, and the like. Similarly, the patient's familyhistory is noted, to provide a general indication of potentialpre-dispositions to medical conditions and events. Hospitalizations arealso noted, including in-patient stays and emergency room visits, as aresurgeries, both major and minor, with information relating to anesthesiaand particular invasive procedures.

[0267] Medical history data may also include data from other physiciansand sources, such as significant or recent blood tests which provide ageneral background for conditions experienced by the patient. Similarinformation, such as in the form of film-based images may also be soughtto provide this type of background information.

[0268] The information provided by the patient may also include certaininformation relating to the general social history and lifestyle of thepatient. These may include habits, such as alcohol or tobaccoconsumption, diet, exercise, sports and hobbies, and the like. Workhistory, including current or recent employment or tasks in occupationsmay be of interest, particularly information relating to hazardous,risky or stressful tasks.

[0269] Psychiatric, Psychological History, and Behavioral Testing

[0270] A patient's psychiatric history may be of interest, particularlywhere symptoms or predispositions to treatable or identifiablepsychiatric conditions may be of concern. In particular, psychiatristscan provide medication to control a wide range of psychiatric symptoms.Most psychiatrists also provide psychotherapy and counseling services topatients, as well as, where appropriate, to couples, groups, andfamilies. Moreover, psychiatrists can administer electroconvulsive shocktherapy (ECT). Psychiatrists are more likely than psychologists to treatindividuals with severe mental disorders, and to work with patients onan in-patient basis in a clinical setting. Psychiatric history may bevery generally sought, such as on questionnaires before or during officevisits, or may be determined through more extensive questioning ortesting.

[0271] The psychological history, as opposed strictly to the psychiatrichistory, may depend upon the special interests of the patient seekingcare. In particular, the services provided by psychologists willtypically depend upon their training, with certain psychologistsproviding psychotherapy and counseling to individuals, groups, couplesand families. Psychologists are also typically trained in theadministration, scoring and interpretation of psychological tests. Suchtests can assess a variety of psychological factors, includingintelligence, personality traits (e.g. via tests such as the KeirseyTemperament Sorter, the Meyers-Briggs Type Indicator), relationshipfactors, brain dysfunction, and psychopathology. Neuropsychologists maybe also do cognitive retraining with brain injured patients.

[0272] Behavioral testing is somewhat similar to psychological testing,and may identify cognitive behavioral disorders or simply behavioralpatterns. Such tests may be provided in conjunction with psychiatric orpsychological evaluations to determine a root cause, psychiatric,psychological or physiological, to certain observed behavior in apatient. Where appropriate, treatment may include counseling or drugadministration.

[0273] Demographic Data

[0274] Certain of the data collected from a patient may be intended toassociate the patient with certain groups or population of knowncharacteristics. Statistical study of human populations generallyinclude such demographic data, specially with reference to size anddensity, distribution, and vital statistics of populations withparticular characteristics. Among the demographic variables which may betypically noted are gender, age, race, ethnicity, religious affiliation,marital status, size of household, native language, citizenship,occupation, life expectancy, birthrate, mortality, education level,income, population, water supply and sanitation, housing, literacy,unemployment, disease prevalence, and health risk factors. As notedbelow, in accordance with aspects of the present technique,patient-specific or patient-adapted feedback or counseling may beprovided, including on an automated basis by the present technique basedat least upon such demographic data.

[0275] Drug Use

[0276] Information relating to drug use, similar to general informationcollected during an examination is typically of particular interest.Such information may include the use of legal and illegal drugs,prescription medications, over-the-counter medications, and so forth.Also, specific substance, even though not generally considered as a drugby a patient may be noted under such categorizations, includingvitamins, dietary supplements, alcohol, tobacco, and so forth.

[0277] Food Intake

[0278] In addition to the information generally collected from thepatient regarding diet and medication, specific food intake informationmay be of interest, depending upon the patient condition. Suchinformation may be utilized to provide specific nutritional counselingto address specific conditions or the general health of the patient.Food intake information generally also includes information regardingthe patient's physical activity, ethnic or cultural background, and homelife and meal patterns. Specific information regarding appetite andattitude towards food and eating may also be noted and discussed withthe patient. Specific allergies, intolerances and food avoidances are ofparticular interest to address known and unknown symptoms experienced bypatients. Similarly, dental and oral health, gastro-intestinal problems,and issue of chronic disease may be of interest in counseling clientsfor food intake or similar issues. Food intake information may alsoaddress specific medications or perceived dietary or nutritionalproblems known to the patient. Also of particular interest are itemsrelating to remote and recent significant weight changes experienced.

[0279] Certain assessments may be made relating to food intake basedupon information collected or detected from a patient. Such evaluationsmay include anthropometric data, biochemical assessments, body massindex data, and caloric requirements. Similarly, from patientanthropometric data, ideal body weight and usual body weight informationmay be computed for further counseling and diagnostic purposes.

[0280] Environmental Factors

[0281] Various environmental factors are of particular interest inevaluating patient conditions and predispositions for certainconditions. Similar to demographic information, the environmentalfactors may aide in evaluating potential conditions which are much moresubtle and difficult to identify. Typical environmental factors mayinclude, quite generally, life events, exercise, and so forth. Moreover,information on the specific patient or the patient living conditions maybe noted, including air pollution, ozone depletion, pesticides, climate,electromagnetic radiation levels, ultraviolet exposure, chemicalexposure, asbestos, lead, radon, or other specific exposures, and soforth. Such information may be associated with population information orknown relational data, such as problems with teeth and bones associatedwith fluoride, potential cancer links associated with volatile organics(e.g. benzene, carbon tetrachloride, and so forth), gastrointestinalillnesses and other problems associated with bacteria and viruses (e.g.E. coli, giardia lamblia, and so forth), and lengths of cancer, liverdamage, kidney damage, and nervous system damage related to inorganics(e.g. asbestos, mercury, nitrates, and so forth).

[0282] Gross Pathology

[0283] Gross pathology, in general, relates to information on thestructure and function of the primary human systems. Such systemsinclude the skeletal system, the endocrine system, the reproductivesystem, the nervous system, the muscular system, the urinary system, thedigestive system, and the respiratory system. Such gross pathologyinformation may be collected in specific inquiries or examinations, ormay be collected in conjunction with other general inquiries such as thephysical examination or patient history data collection processesdescribed above. Moreover, certain aspects of the gross anatomyinformation may be gleaned from reference texts, autopsies,anthropomorphic databases, such as the Visible Human Project, and soforth.

[0284] Information from Non-Biologic Models

[0285] Information from non-biologic models may also be of particularinterest in assessing and diagnosing patient conditions. The informationis also of particular interest in the overall management of patientcare. Information included in this general category of resourcesincludes health insurance information and healthcare financialinformation. Moreover, for a medical institution, significant amounts ofinformation are necessary to provide adequate patient care on a timelybases, including careful control of management, workflow, and humanresources. In institutions providing living arrangements for patients,the data must also include such items as food service, hospitalfinancial information and patient financial information. Much of theinformation that is patient-specific may be accumulated by aninstitution in a general patient record.

[0286] Other specific information for institutions which aide in theoverall management may include information on the business-relatedaspects of the institution alone or in conjunction with other associatedinstitutions. This information may include data indicative of geographiclocations of hospitals, types of clinics, sizes of clinics, specialtiesof clinics or departments or physicians, and so forth. Patient educationmaterials may also be of particular interest in this group, and thepatient educational materials may be specifically adapted for individualpatients as described in greater detail below. Finally, informationrelating to relationships with physicians, including physician referralsand physician needs and preferences may also be of particular interestin this category of resources.

[0287] Processing and Analysis

[0288] The processing and analysis functions described above performedby the data processing system 10 may take many forms depending upon thedata on which the processing is based, the types of analysis desired,and the purpose for the output of the data. In particular, however, theprocessing and analysis is preferably performed on a wide range of datafrom the various resources, in conjunction with the integrated knowledgebase 12. Among the various modalities and types of resources, severalscenarios may be envisaged for performing the processing and analysis.These include analyses that are performed based upon a single modalitymedical system or resource, single-type multi-modality combinations, andmulti-type, multi-modality configurations. Moreover, as noted above,various computer-assisted processing, acquisition, and analysis modulesmay be employed for one or more of the modality and type scenarios. Thefollowing is a description of certain exemplary implementations ofmodality-based, type-based and computer-assisted processing-basedapproaches to the use of the data collected and stored by the presentsystem.

[0289] Modalities and Types

[0290] In a single modality medical system, a clinician initiates achain of events for the patient data. The events are broken down intovarious modules, such as the acquisition module, processing module,analysis module, report module and archive module as discussed above. Inthe traditional method, the report goes back to the referring clinician.

[0291] In the present technique, computer processing may be introducedto perform several data operation tasks. In general, in the presentdiscussion, algorithms for performing such operations are referred to asdata operating algorithms or CAX algorithms. While more will be saidabout currently contemplated CAX algorithms and their interaction andintegration, at this point, certain such algorithms will be referred togenerally, including computer aided acquisition algorithms (CAA),computer aided processing algorithms (CAP), computer aided detectionalgorithms (CAD). The implemented software also serves to manage theoverall work flow, optimizing parameters of each stage from theknowledge of the same module at the present time or at previous times,and/or data from other modules at the present time or at previous times.Furthermore, as shown in the FIG. 1, the knowledge base 12 iscreated/updated with new data and essentially drives the variouscomputer-aided modules. Thus, knowledge base 12 creation and updates arelinked with the comuter aided methods to implement the single modalityunit. The details of the CAX modules, including CAA, CAP, CAD, modules86, 88, 90 (see, e.g. FIG. 5), and knowledge base 12 are detailed below.Furthermore, it should be noted that each of these modules may bespecialized for a given clinical question. Thus, if the same clinicalquestion requires multiple acquisitions, for example, or multipleprocessing and multiple analyses at different time points, thetechniques can be generalized to accommodate the temporal aspects ofdata.

[0292] A single-type, multi-modality medical system, in the presentcontext, may consist of any of the columns of the FIG. 8. In FIG. 7, adiagrammatical representation a single-type, multi-modality system withthe temporal attributes is illustrated, considering M modalities at Ndifferent time points. Of course, all the attributes of a singlemodality are also applicable to any of the modalities in themulti-modality context, and the diagram simply highlights theinteraction between multiple modalities. In FIGS. 6 and 7, interactionwithin each type is also evident, such as to optimize acquisition,processing and analysis of data. The temporal aspects of a medical eventare also considered in the context, such as to modify acquisition,processing and analysis modules based on the temporal attributes of thedata. As discussed below, the logic engine 24 (see, e.g. FIG. 5), ormore generally, the processing system 10 may use rules to optimizeacquisition, processing, and analysis of data between the modalitiesusing the knowledge base 12.

[0293] A multi-type, multi-modality medical system essentially may coverthe entire range of resources available, including the types andmodalities summarized in FIG. 8 In FIG. 6, a diagrammaticalrepresentation of a multi-type, multi-modality system with temporalattributes is illustrated, considering different time points. As before,all of the attributes of single-type, multi-modality systems areapplicable for any of the types, and the schematic highlights theinteraction between multiple types and multiple modalities. In themulti-type, multi-modality context, the interaction among modalities ofdifferent types can be used to optimize acquisition, processing andanalysis of the data. Here again, the temporal aspects of a medicalevent from multiple types may be considered and used to modifyacquisition, processing and analysis modules based on the temporalattributes of the data. Logic engine 24, and again more generallyprocessing system 10 may use rules to optimize acquisition, processing,and analysis of data between the modalities using the knowledge base.System 10, uses data from tools or modules, such as CAX modules, or, asshown for certain specific such modules, CAA, CAP, CAD modules 86, 88,90 and from knowledge base 12, and then establishes the relationship,which could then be part of the knowledge base 12.

[0294] While any suitable processing algorithms and programs may beutilized to obtain the benefits of the integrated knowledge baseapproach of the present technique, certain adaptations and integrationof the types of programs available may be made for this purpose. Asnoted above, exemplary computer-assisted data operating algorithms andmodules for analyzing medical-related data include computer-assisteddiagnosis modules, computer-assisted acquisition modules, andcomputer-assisted processing modules. The present technique greatlyenhances the ability to develop, refine and implement such algorithms byvirtue of the high level of integration afforded. More detail isprovided below regarding the nature and operation of the algorithms, aswell as their interaction and interfacing in accordance with aspects ofthe present technique

[0295] Integrated Knowledge Base

[0296] As noted above, the integrated knowledge base employed in thepresent technique can be a highly integrated resource comprised of oneor more memory devices at one or more locations linked to one anothervia any desired network links. The integrated knowledge base may furtherinclude memory devices on client components, such as the resourcesthemselves, as will commonly be the case in certain imaging systems. Inlimited implementations, the integrated knowledge base may combine veryfew such resources. In larger implementations, or as an implementationis expanded over time, further integration and interrelation betweendata and resources may be provided. As noted throughout the presentdiscussion, any and all of the resources may not only serve as users ofthe data, but may provide data where desired.

[0297] The presently contemplated integrated knowledge base may includeraw data as well as semi-processed data, processed data, reports,tabulated data, tagged data, and so forth. In a minimal implementation,the integrated knowledge base may comprise a subset of raw data or rawdata basis. However, in a more preferred implementation, the integratedknowledge base is a superset of such raw databases and further includesfiltered, processed, or reduced dimension data, expert opinioninformation, such as relating to rules of clinical events, predictivemodels, such as based upon symptoms or other inputs and disease ortreatment considerations or other outputs, relationships,interconnections, trends, and so forth. As also noted throughout thepresent discussion, contents of the integrated knowledge base may bevalidated and verified, as well as synchronized between various memorydevices which provide or draw upon the knowledge present in theknowledge base.

[0298] In general, the integrated knowledge base as presentlycontemplated enables evidence-based medicine to be seamlessly integratedinto common practice of medicine and the entire healthcare enterprise.That is, the integrated knowledge base serves to augment the wealth ofdomain knowledge and experience mentally maintained by the clinicians orusers as well as the related clinical and non-clinical communities whichprovide data and draw upon the data in the various algorithmic programsimplemented. Also as described throughout the present discussion, theintegrated knowledge base may be distributed and federated in nature,such as to accommodate raw databases, data resources, and controllableand prescribable resources.

[0299] Current practice for knowledge base creation is to collectrepresentative data for a particular clinical event, set up adomain-expert panel to review the data, use experts to categorize thedata into different valid groupings, and corroborate the expert findingswith some reference standard technique. For example, to create an imageknowledge base of lung nodule determination from radiography images, theexpert panel may group images in terms of degree of subtlety of nodulesand corroborate the radiological findings with biopsies. In the presenttechnique, such methodologies may serve as a first basic step for givendata of clinical relevance. However, the classification process may thenbe automated based on the attributes provided by domain experts andadjunct methods. In one embodiment, any clinical data may beautomatically categorized and indexed so that it can be retrieved ondemand for various intended purposes.

[0300] Logic Engine

[0301] The logic engine essentially contains the rules that coordinatethe various functions carried out by the system. Such coordinationincludes accessing and storing data in the knowledge base, as well asexecution of various computer-assisted data operating algorithms, suchas for feature detection, diagnosis, acquisition, processing anddecision-support. The logic engine can be rule-based, and may include asupervised learning or unsupervised learning system. By way of example,functions performed by the logic engine may include data trafficcontrol, initiation of processing, linking to resources, connectivity,coordination of processing (e.g. sequencing), and coordination ofcertain activities such as access control, “handshaking” of components,interface definition, and so forth.

[0302] Temporal Processing Module

[0303] In accordance with one aspect of the present techniques involvessimply performing temporal change analysis on a single modality data.The results can be presented to the user by displaying temporal changedata and the current data side-by-side, or by fusing the temporalresults on the current data to highlight temporal changes. Anotherapproach is to use data of at least one modality and its temporalcounterpart from another modality to perform temporal change analysis.Yet another approach would involve performing temporal analysis onmultiple-type data to fully characterize the medical condition inquestion.

[0304] Temporal processing may generally include the following generalmodules: acquisition/storage module, segmentation module, registrationmodule, comparison module, and reporting module.

[0305] The acquisition/storage module contains acquired medical data.For temporal change analysis, means are provided to access the data fromstorage corresponding to an earlier time point. To simplify notation inthe subsequent discussion we describe only two time points t₁ and t₂,even though the general approach can be extended for any type of medicaldata in the acquisition and temporal sequence. The segmentation moduleprovides automated or manual means for isolating features, volumes,regions, lines, and/or points of interest. In many cases of practicalinterest, the entire data can be the output of the segmentation module.The registration module provides methods of registration for disparatemedical data. Several examples may assist in illustrating this point.

[0306] In case of single modality medical images, if the regions ofinterest for temporal change analysis are small, rigid body registrationtransformations, including translation, rotation, magnification, andshearing may be sufficient to register a pair of images from t₁ and t₂.However, if the regions of interest are large, such as including almostan entire image, warped, elastic transformations may be applied. One wayto implement the warped registration is to use a multi-scale,multi-region, pyramidal approach. In this approach, a different costfunction highlighting changes may be optimized at every scale. An imageis resampled at a given scale, and then it is divided into multipleregions. Separate shift vectors are calculated at different regions.Shift vectors are interpolated to produce a smooth shift transformation,which is applied to warp the image. The image is resampled and thewarped registration process is repeated at the next higher scale untilthe pre-determined final scale is reached.

[0307] In the case of multi-modality medical images, maximizing mutualinformation can perform rigid and warped registration. In certainmedical data, there may not be a need to do any spatial registration atall. In such cases, data would be a single scale value or a vector.

[0308] The comparison module provides methods of comparison fordisparate medical data. For Example, registered image comparison can beperformed in several ways. One method involves subtracting two images toproduce a difference image. Alternatively, two images S(t₁) and S(t₂)can be compared using an enhanced division method, which is described as[S(t₁)* S(t₂)]/[S(t₂)* S(t₂)+Φ], where the scalar constant Φ>0. In thecase of single scalar values, temporal trends for a medical event can becompared with respect to known trends for normal and abnormal cases.

[0309] The report module provides the display and quantificationcapabilities for the user to visualize and or quantify the results oftemporal comparison. In practice, one would use all the available datafor the analysis. In the case of medical images, several differentvisualization methods can be employed. Results of temporal comparisonscan be simultaneously displayed or overlaid on one another using alogical operator based on some pre-specified criterion. For quantitativecomparison, color look-up tables can be used. The resultant data canalso be coupled with an automated pattern recognition technique toperform further qualitative and/or manual/automated quantitativeanalysis of the results.

[0310] Artificial Neural Network

[0311] A general diagrammatical representation of an artificial neuralnetwork is shown in FIG. 15 and designated by the reference numeral 202.Artificial neural networks consist of a number of units and connectionsbetween them, and can be implemented by hardware and/or software. Theunits of the neural network may generally be categorized into threetypes of different groups (layers), according to their functions, asillustrated in FIG. 15. A first layer, input layer 204, is assigned toaccept a set of data representing an input pattern, a second layer,output layer 208, is assigned to provide a set of data representing anoutput pattern, and an arbitrary number of intermediate layers, hiddenlayers 206, convert the input pattern to the output pattern. Because thenumber of units in each layer is determined arbitrarily, the input layerand the output layer include sufficient numbers of units to representthe input patterns and output patterns, respectively, of a problem to besolved. Neural networks have been used to implement computationalmethods that learn to distinguish between objects or classes of events.The networks are first trained by presentation of known data aboutobjects or classes of events, and then are applied to distinguishbetween unknown objects or classes of events.

[0312] Briefly, the principle of neural network 202 can be explained inthe following manner. Normalized input data 210, which may berepresented by numbers ranging from 0 to 1, are supplied to input unitsof the neural network. Next, the output data 212 are provided fromoutput units through two successive nonlinear calculations (in a case ofone hidden layer 206) in the hidden and output layers 208, 210. Thecalculation at each unit in the layer, excluding the input units, mayinclude a weighted summation of all entry numbers, an addition ofcertain offset terms and a conversion into a number ranging from 0 to 1typically using a sigmoid-shape function. In particular, as representeddiagrammatically in FIG. 16, units 214, which may be labeled O₁ toO_(n), represent input or hidden units, W₁ through W_(n) represent theweighting factors 216 assigned to each respective output from theseinput or hidden units, and T represents the summation of the outputsmultiplied by the respective weighting factors. An output 218, or O iscalculated using the sigmoid function 220 given where θ represents anoffset value for T. An example sigmoid function is given by thefollowing expression: 1/[1+exp(−T+θ)]. The weighting factors and offsetvalues are internal parameters of the neural network 202, which aredetermined for a given set of input and output data.

[0313] Two different basic processes are involved in the neural network202, namely, a training process and a testing process. The neuralnetwork is trained by the back-propagation algorithm using pairs oftraining input data and desired output data. The internal parameters ofthe neural network are adjusted to minimize the difference between theactual outputs of the neural network and the desired outputs. Byiteration of this procedure in a random sequence for the same set ofinput and output data, the neural network learns a relationship betweenthe training input data and the desired output data. Once trainedsufficiently, the neural network can distinguish different input dataaccording to its learning experience.

[0314] Expert Systems

[0315] One of the results of research in the area of artificialintelligence (AI) has been the development of techniques which allow themodeling of information at higher levels of abstraction. Thesetechniques are embodied in languages or tools, which allow programs tobe built to closely resemble human logic in their implementation and aretherefore easier to develop and maintain. These programs, which emulatehuman expertise in well-defined problem domains, are generally calledexpert systems.

[0316] The component of the expert system that applies the knowledge tothe problem is called the inference engine. Four basic controlcomponents may be generally identified in an inference engine, namely,matching (comparing current rules to given patterns), selection(choosing most appropriate rule), implementation (implementation of thebest rule), and execution (executing resulting actions).

[0317] To build an expert system that solves problems in a given domain,a knowledge engineer, an expert in AI language and representation,starts by reading domain-related literature to become familiar with theissues and the terminology. With that as a foundation, the knowledgeengineer then holds extensive interviews with one or more domain expertsto “acquire” their knowledge. Finally, the knowledge engineer organizesthe results of these interviews and translates them into software that acomputer can use. The interviews typically take the most time and effortof any of these stages.

[0318] Rule-based programming is one of the most commonly usedtechniques for developing expert systems. Other techniques include fuzzyexpert systems, which use a collection of fuzzy membership functions andrules, rather than Boolean logic, to reason relationships between data.In rule-based programming paradigms, rules are used to representheuristics, or “rules of thumb,” which specify a set of actions to beperformed for a given situation. A rule is generally composed of an “if”portion and a “then” portion. The “if” portion of a rule is a series ofpatterns which specify the facts (or data) which cause the rule to beapplicable. The process of matching facts to patterns is generallycalled pattern matching. The expert system tool provides the inferenceengine, which automatically matches facts against patterns and selectsthe most appropriate rule. The “if” portion of a rule can actually bethought of as the “whenever” portion of a rule, because pattern matchingoccurs whenever changes are made to facts. The “then” portion of a ruleis the set of actions to be implemented when the rule is applicable. Theactions of applicable rules are executed when the inference engine isinstructed to begin execution. The inference engine selects a rule, andthen the actions of the selected rule are executed (which may affect thelist of applicable rules by adding or removing facts). The inferenceengine then selects another rule and executes its actions. This processcontinues until no applicable rules remain.

[0319] Initiation of Processing Functions and Strings

[0320] As used herein, the term “processing string” is intended torelate broadly to computer-based activities performed to acquire,analyze, manipulate, enhance, generate or otherwise modify or derivedata within the integrated knowledge base or from data within theintegrated knowledge base. The processing may include, but is notlimited to analysis of patient-specific clinical data. Processingstrings may act upon such data, or upon entirely non-clinical data, butin general will act upon both. Thus, processing strings may includeactivities for acquisition of data (both for initiating acquisition andterminating acquisition, and for setting acquisition settings andprotocols, or notification that acquisition is desired or desirable).

[0321] A user-initiated processing string, for example, might includelaunching of a computer-assisted detection routine to identifycalcifications possibly visible within cardiac CT data. While thisprocessing string proceeds, moreover, the system, based upon therequested routine and the data available from other resources, mayautomatically initiate a processing string which fetches cholesteroltest results from the integrated knowledge base for analysis of possiblerelationships between the requested data analysis and the cholesteroltest results. Conversely, when analysis of cholesterol test results isrequested or initiated, the system may detect the utility in performingimaging that would assist in evaluating or diagnosing relatedconditions, and inform the user (or a different user) of the need ordesirability to schedule acquisition of images that would form the basisfor the complementary evaluation.

[0322] It should also be noted that the users that may initiateprocessing strings may include a wide range of persons with diverseneeds and uses for the raw and processed data. These might include, forexample, radiologists requesting data within and derived from images,insurers requesting information relating or supporting insurance claims,nurses in need of patient history information, pharmacists accessingprescription data, and so forth. Users may also include the patient himor herself, accessing diagnostic information or their own records.Initiation based upon a change in data state may look to actual dataitself, but may also rely on movement of data to or from a newworkstation, uploading or downloading of data, and so forth. Finally,system-initiated processing strings may rely on simple timing (as atperiodic intervals) or may rely on factors such as the relative level ofa parameter or resource. System-initiated processing strings may also belaunched as new protocols or routines become available, as to searchthrough existing data to determine whether the newly availableprocessing might assist in identifying a condition thereforeunrecognized.

[0323] As noted above, the data processing system 10, integratedknowledge base 12, and federated database 14 can all communicate withone another to provide access, translation, analysis and processing ofvarious types of data from the diverse resources available. FIG. 17illustrates this feature of the present technique again, with emphasisupon the interface 8 provided for users, such as clinicians andphysicians. The interface 8, while permitting access to the variousresources of the system, including the data processing system, theintegrated knowledge base, and the federated database, will generallyallow for a wide range of interface types and systems. In particular, asdesignated diagrammatically by the reference numeral 222 in FIG. 17, the“unfederated” interface layer comprising the interface 8 may include arange of disparate and different interface components at singleinstitutions, or at a wide range of different institutions widelygeographically dispersed from one another. Moreover, the basic operatingsystems of the interfaces need not be the same, and the presenttechnique contemplates that various types of interfaces may be unitedand configured in the unfederated interface layer separately, andnevertheless enable to communicate with one or more of the dataprocessing system, the integrated knowledge base and the federateddatabase. In particular, where an integrated knowledge base and afederated database are provided, these may accommodate the various typesof interfaces in the layer, such as through the use of standardizedprotocols as noted above, including HTML, XML, and so forth. Theinterface layer may also permit automatic or use-prompted queries of theintegrated knowledge base, the data processing system, or the federateddatabase. In particular, where appropriate, the users may not be awareof queries executed by programs implemented on workstations, such as bymanagement of input or output of client data, filing of claims,prescription of data acquisition sequences, medications, and so forth.

[0324] The interface layer, and the programming included therein and inthe data processing system may permit a wide range of processingfunctions to be executed based upon a range of triggering events. Theseevents maybe initiated and carried out in conjunction with use requests,or may be initiated in various other manners. FIG. 18 diagrammaticallyillustrates certain of the initiating and processing functions which maybe performed in this manner.

[0325] As shown in FIG. 18, various initiating sources 224 may beconsidered for initiating the data acquisition, processing, and analysison the data from the resources and knowledge base described above. Theinitiating sources 224 commence processing as indicated generally atreference numeral 226 in FIG. 18, in accordance with routines stored inone or more of the data processing system, integrated knowledge base,and federated database, or further more within the resources, includingthe controllable prescribable resources and the data resources. Theparticular processing may be stored, as noted above, and a singlecomputer system comprised in the data processing system, or dispersedthrough various computer systems which cooperate with one another toperform the data processing and analysis. Following initiation of theprocessing, processing strings may be carried out as indicated generallyat reference numeral 228 in FIG. 18. These processing strings mayinclude a wide range of processing and analysis of functions, typicallydesigned to provide a caregiver with enhanced insights into patientcare, to process the data required for the patient care, includingclinical and non-clinical data, to enhance function of an institutionproviding the care, to detect trends or relationships within the patientdata, and to perform general discovery and mining of relationships forfuture use.

[0326] The present technique contemplates that a range of initiatingsources 224 may commence the processing and analysis functions inaccordance with the routines executed by the system. In particular, forsuch initiating sources are illustrated in FIG. 18, including a userinitiating source 230, an event or patient initiating source 232, a datastate change source 234, and a system or automatic initiating source236. Where a user, such as a clinician, physician, insurance company,clinic or hospital employee, management or staff user, and the likeinitiates a request that draws upon the integrated knowledge base or thevarious integrated resources described above, a processing string maybegin that calls upon information either already stored within theintegrated knowledge base or accessible by locating, accessing, andprocessing data within one or more of the various resources. In atypical setting, a user may initiate such processing at a workstationwhere a query or other function is performed. As noted above, the querymay be obvious to the user, or may be inherent in the function performedon the workstation.

[0327] Another contemplated initiating source is the event or patient asindicated at reference numeral 232 in FIG. 18. In general, many medicalinteractions will begin with specific symptoms or medical events whichtrigger contact with a medical institution or practitioner. Upon loggingsuch an event by a patient or clinician interfacing with the patient, aprocessing string may begin which will include a range of interactivesteps, such as access to patient records, updating of patient records,acquisition of details relating to symptoms, and so forth as describedmore fully below. The event to patient initiated processing string,while used to perform heretofore unavailable and highly integratedprocessing in the present context, may be generally similar to the typesof events which drive current medical service provision.

[0328] The data processing system 10 may generally monitor a wide rangeof data parameters, including the very state of the data (static orchanging) to detect when new data becomes available. The new data maybecome available by updating patient records, accessing new information,uploading or downloading data to and from the various controllable andprescribable resources and data resources, and so forth. Where desired,the programs executed by the data processing system may initiateprocessing based upon such changes in the state of data. By way ofexample, upon detecting that a patient record has been updated by arecent patient contact or the availability of clinical or non-clinicaldata, the processing string may determine whether subsequent actions,notifications, reports or examinations are in order. Similarly, theprograms carried out by the data processing system may automaticallyinitiate certain processing as indicated at reference numeral 236 inFIG. 18. Such system-initiated processing may be performed on a routinebases, such as predetermined time intervals or at the trigger of varioussystem parameters, such as inventory levels, newly-available data oridentification of relationships between data, and so forth.

[0329] A particularly powerful aspect of the highly integrated approachof the present technique resides in the fact that, regardless of theinitiating source of the processing, various processing strings mayresult. As summarized generally in FIG. 18, for example, the processingstrings 228, while generally aligned with various initiating sources inthe figure, may result from other initiating sources and executedprograms. For example, a user or context string 238 may includeprocessing which accesses and returns processed information to respondprecisely to a user-initiated processing event, or in conjunction withthe particular context within which a user accesses the system. However,such processing strings may also result from event or patient initiatedprocessing, data state changes, and system-initiated processing.Moreover, it should be noted that several types of specific strings mayfollow within the various categories. For example, the user or contextstring 238 may include specific query-based processing as indicated atreference numeral 240, designed to identify and return data which isresponsive to specific queries posed by a user. Alternatively, user orenvironment-based strings 242 may result in which data accessed andreturned is user-specific or environment-specific. Examples of suchprocessing strings might include access and processing of data foranalysis of interest to specific users, such as specific types ofclinicians or physicians, financial institutions, and insurancecompanies.

[0330] As a further example of the various processing strings which mayresult from the initiating source processing, event strings 244 mayinclude processing which is specific to the medical event experienced bya patient, or to events experienced in the past or which may be possiblein future. Thus, the event strings 244 may result from user initiation,event or patient initiation, data state change initiation, or systeminitiation. In a typical context, the event string may simply follow theprocess of a medical event or symptom being experienced by a patient toaccess information, process the information, and provide suggestions ordiagnoses based upon the processing. As noted above, the suggestions mayinclude the performance of additional processing or analysis, theacquisition of additional information, both automatically and withmanual assistance, and so forth.

[0331] A general detection string 246 might also be initiated by thevarious initiating sources. In the present context, the generaldetection string 246 may include processing designed to identifyrelevant data or relationships which were not specifically requested bya user, event, patient, data state change or by the system. Such generaldetection strings may correlate new data in accordance withrelationships identified by the data processing system or integratedknowledge base. Thus, even where a patient or user has not specificallyrequested detection of relationships or potential correlations, programsexecuted by the data processing system 10 may nevertheless executecomparisons and groupings to identify risks, potential treatments,financial management options and so forth under a general detectionstring.

[0332] Finally, a processing string designated in FIG. 18 as a systemstring 248 may be even more general in nature. The system string may beprocessing which is executed with the goal of discovering relationshipsbetween data available from the various resources. These newrelationships may be indicative of new ways to diagnose or treatpatients such as based upon recognizable trends or correlations,analysis of success or failure rates, statistical analyses of patientcare results, and so forth. As in the previous examples, the systemstring may be initiated in various manners, including at the automaticinitiation of the system, but also with changes in data state, upon theoccurrence of newly detected medical event or by initiation of thepatient, or by a specific request of a user.

[0333] Computer-Assisted Patient Data Capture and Processing

[0334] In accordance with one aspect of the present technique, enhancedprocessing of patient data is provided by coordinating data collectionand processing directly from the patient with data stored in theintegrated knowledge base 12. For the present purposes, it should beborne in mind that the integrated knowledge base 12 may be considered toinclude information within various resources themselves, or processedinformation resulting from analysis of such raw data. Moreover, in thepresent context the integrated knowledge base is considered to includedata which may be stored in a variety of locations both within aninstitution and within a variety of institutions located in a singlelocation or in quite disparate locations. The integrated knowledge basemay, therefore, include a variety of coordinated data collection andrepository sites. Exemplary logical action classes and timeframes, withassociated exemplary actions, are illustrated generally in FIG. 19.

[0335] Referring to FIG. 19, the patient information which is includedin the integrated knowledge base may result from any one or more of thetypes of modalities described above, and, more generally, of the variousresource types. Moreover, as also described above, patient informationmay result from analysis of this type of data in conjunction with othergenerally available data in the data resources, such as differentgraphic information, proprietary or generally accessible databases,subscription databases, digitized reference materials, and so forth.However, the information is particularly useful when coordinated with apatient contact, such as a visit to a physician or facility. In thediagrammatical representation of FIG. 19, different distinct classes ofaction, designated generally at reference numeral 250, may be groupedlogically, such as patient interactions, system interactions, and reportor education-type actions. These action classes may be furtherconsidered, generally, as inputs, processing, and outputs of the overallsystem. Moreover, the action classes may be thought of as occurring byreference to a patient contact, such as an on-site visit. In this sense,the actions may be generally classified as those taken prior to a visitor contact, as noted at reference numeral 252, those taken during acontact, as illustrated at reference numeral 254, and post-contactactions, as indicated at reference numeral 256.

[0336] It has been found, in the present technique, that by collectionof certain patient information at these various stages of interaction,information from the integrated knowledge base may be extremely usefulin providing enhanced diagnosis, analysis, patient care, and patientinstruction. In particular, several typical scenarios may be envisagedfor the collection and processing of data prior to a patient contact oron-site visit.

[0337] As an example of the type of information which may be collectedprior to a patient contact, sub-classes of actions may be performed, asindicated at reference numeral 258 in FIG. 19. By way of example, priorto a patient visit, a record for the patient contact or medical event(e.g. the reason for the visit) may be captured to begin a new orcontinuing record. Such initiation may begin by a patient phone call,information entered into a website or other interface, instant messages,chat room messages, electronic messages, information input via a webcamera, and so forth. The data relating to the record may be inputeither with human interaction or by automatic prompting or even throughunstructured questionnaires. In such questionnaires, the patient may beprompted to input a chief complaint or symptoms, medical events, and thelike, with prompting from voice, textual or graphical interfacing. Inone exemplary embodiment, for example, the patient may also respond tographical depictions of the human body, such as for selection ofsymptomatic region of the body.

[0338] Other information may be gathered prior to the patient contact,such as biometric information. Such information may be used for patientidentification and/or authentication before data is entered into thepatient record. Moreover, remote vital sign diagnostics may be acquiredby patient input or by remote monitors, if available. Where data iscollected by voice recording, speech recognition software or similarsoftware engines may identify key medical terms for later analysis.Also, where necessary, particularly in emergency situations, residentialor business addresses, cellular telephone locations, computer terminallocations, and the like can be accessed to identify the physicallocation of a patient. Moreover, patient insurance information can bequeried, with input by the patient to the extent such information isknown or available.

[0339] Based upon the patient interactions 258, various systeminteractions 260 may be taken prior to the patient visit or contact. Inparticular, as the patient-specific data is acquired, data is accessedfrom the integrated knowledge base (including the various resources) foranalysis of the patient information. Thus, the data may be associated oranalyzed to identify whether appointments for visits are in order, ifnot already arranged, and such appointments may be scheduled based uponthe availability of resources and facilities, patient preferences andlocation, and so forth. Moreover, the urgency of such scheduledappointments may be assessed based upon the information input by thepatient.

[0340] Among the various recommendations which may be made based uponthe analysis, pre-visit imaging, laboratory examinations, and so forthmay be recommended and scheduled to provide the most relevantinformation likely to be needed for efficient diagnosis and feedbackduring or immediately after the patient visit. Such recommendations mayentail one or more of the various types of resources described above,and one or more of the modalities within each resource. The variousinformation may also be correlated with information in the integratedknowledge base to provide indications of potential diagnoses or relevantquestions and information that can be gathered during the patient visit.The entire set of data can then be uploaded to the integrated knowledgebase to create or supplement a patient history database within theintegrated knowledge base.

[0341] As a result of the uploading of data into the integratedknowledge base, various types of structured data may be stored for lateraccess and processing. For example, the most relevant captured patientdata may be stored, in a structured form, such as by classes or fieldswhich can be searched and used to evaluate potential recommendations forthe procedures used prior to the medical visit, during the visit andafter the visit. The data may be used, then for temporal analysis ofchanges in patient conditions, identification of trends, evaluation ofsymptoms recognized by the patient, and general evaluation of conditionswhich may not even be recognized by the patient and which are notspecifically being complained of. The data may also include, and beprocessed to recognize, potentially relevant evidence-based data,demographic risk assessments, and results of comparisons and analyses ofhypothesis for the existence or predisposition for medical events andconditions.

[0342] Following the system interaction, and resulting from the systeminteraction, various output-type functions may be performed by thesystem. For example, as noted at reference numeral 262 in FIG. 19,patient-specific recommendations may be communicated to the patientprior to the patient contact. These recommendations may includeappointments for the contact or for other examinations or analyses,educational information relating to such procedures, protocols to befollowed prior to the procedures (e.g. dietary recommendations,prescriptions, timing and duration of visits). Moreover, the patientinformation may be specifically tailored or adapted to the patient. Inaccordance with one aspect of the technique, for example, educationalinformation may be conveyed to the patient in a specific language ofpreference based upon textual information available in the integratedknowledge base and the language of preference indicated by the patientin the patient record. Such instructions may further include detaileddata, such as driving or public transportation directions, contactinformation (telephone and facsimile numbers, website addresses, etc.).As noted above, actions may include ordering and scheduling of exams anddata acquisition.

[0343] A further output action which may be taken by the system prior toand on-site visit might include reports or recommendations forclinicians and physicians. In particular, the reports may include outputbased upon the indications and designation of symptoms experienced bythe patient, patient history information collect, and so forth. Thereport may also include electronic versions of images, computer-assistedprocessed (e.g. enhanced) images, and so forth. Moreover, such physicianreports may include recommendations or prioritized lists of informationor examinations which should be performed during the visit to refine orrule out specific diagnoses.

[0344] The process summarized in FIG. 19 continues with informationwhich is collected by patient interaction during a contact, such as anon-site visit, as indicated at reference numeral 264. In a presentexample, the information collected at the time of the contact mightbegin with biometric information which, again can be used for patientidentification and authentication. The visit may thus begin with acheck-in process in which the patient is either registered on-site orpre-registered off-site prior to a visit. Coordinated systeminteractions may be taken during this time, such as automatic access tothe patient record established during the pre-visit phase. Additionalinformation, similar to or supplementing the information collected priorto the visit may then be entered into the patient record. Patientconversation and inputs may be recorded manually or automatically duringthis interview process in preparation for a clinician or physicianinterview. As before, where voice data is collected, speech recognitionengines may identify key medical terms or symptoms which can beassociated with information in the integrated knowledge base to furtherenhance the diagnosis or treatment. Video data may similarly becollected to assess patient interaction, mental or physical state, andso forth. This entire check-in process may be partially or fullyautomated to make optimal use of institutional resources prior to actualinterview with a clinician, nurse, or physician.

[0345] The on-visit may continue with an interview by a clinician ornurse. The patient conversation or interaction may again be recorded inaudio or video formats, with complaints, symptoms and other key databeing input into the integrated knowledge base, such as foridentification of trends and temporal analysis of advancement of acondition or event. Again, and similarly, vital sign information may beupdated, and the updated patient record may be evaluated foridentification of trends and possible diagnoses, as well as orrecommendations of additional medical procedures, as noted above.

[0346] The on-site visit typically continues with a physician orclinician interview. As noted above, during the on-site visit itself,analyses and correlations with information in the integrated knowledgebase may be performed with reports or recommendations being provided tothe physician at the time of the interview. Again, the reports mayprovide recommendations, such as rank-ordered proposals for potentialdiagnoses, procedures, or simply information which can be gathereddirectly from the patient to enhance the diagnosis and treatment. Theinterview itself may, again, be recorded in whole or in part, and keymedical terms recognized and stored in the patient's record for lateruse. Also during the on-site visit, reports, recommendations,educational material, and so forth may be generated for the patient orthe patient care provider. Such information, again, may be customizedfor the patient and the patient condition, including explanations of theresults of examinations, presentations of the follow-up procedures ifany, and so forth. The materials may further include general healthrecommendations based upon the patient record, interaction during thecontact and information from the integrated knowledge base, includinggeneral reference material. The material provided to the patient mayinclude, without limitation, text, images, animations, graphics, andother reference material, raw or processed, structured video and/oraudio recordings of questions and answers, general data on background,diagnoses, medical regimens, risks, referrals, and so forth. The form ofsuch output may suit any desired format, including hard-copy printout,compact disk output, portable storage media, encrypted electronicmessages, and so forth. As before, the communication may also bespecifically adapted to the patient in a language of preference. Theoutput may also include information on financial arrangements, includinginsurance data, claims data, and so forth.

[0347] The technique further allows for post-contact data collection andanalysis. For example, following a patient visit, various patientinteractions may be envisaged, as indicated generally at referencenumeral 266 in FIG. 19. Such interactions may include general follow-upquestions, symptom updates, remote vital sign capture, and the like,generally similar to information collected prior to the contact.Moreover, the post-contact patient interaction may include patientrating of an institution or care providers, assistance in filing orprocessing insurance claims, invoicing, and the like. Again, based uponsuch inputs, data is accessed, which may be patient-specific or moregeneral in nature, from the integrated knowledge base to permit theinformation to the coordinated with patient records and all otheravailable data to facilitate the follow-up activities, and to generateany reports and feedback both for the patient and for the care provider.

[0348] Integrated Knowledge Base Interface

[0349] As noted above, the “unfederated” interface for the integratedknowledge base and, more generally, for the processing system andresources, may be specifically adapted for a variety of users,environments, functions, and the like. FIG. 20 generally illustrates aninterface processing system which facilitates interactions with theintegrated knowledge base. The system generally includes a series ofinput parameters or sources 270, which may be widely varied in nature,location, and utility. Based upon inputs from such sources, a logicalparser 272, which may be generally part of the data processing system 10described above, identifies interfaces and access of for interactionbetween users, hardware, and systems on one hand, and user workstationson the other, as well as access to the integrated knowledge base. Theinterface and access output functions, indicated generally at referencenumeral 274, are then used to provide customized interfaces and accessto the integrated knowledge base depending upon the inputs received bythe parser.

[0350] As summarized in FIG. 20, input parameters or sources 270 maygenerally include parameters relating to users, including patients 4 andclinicians 6, as well as to any other users of the system, such asfinancial or insurance companies, researchers, and any other persons orinstitutions having the right to access the data. For user-initiatedevents, or any contact with the integrated knowledge base in which auser is involved, various access levels, functions, profiles,environments and the like may be considered in customizing the userinterface and the level of access to the integrated knowledge base dataand processing capabilities. By way of example, a radiologist reviewingan image or images at a review workstation, a technologist operating aCT scanner, or an administrator scheduling appointments or enteringbilling information may all be users to the system. The parameters orcharacteristics of the user which may be considered by the logicalparser 272 may, as noted, vary greatly. In a present exemplaryembodiment such characteristics include the function being performed bythe user, as noted at reference numeral 276, as well as a personalprofile of a user as noted at reference numeral 278. The informationrelating to functions and personal profiles may, where appropriate, besubject to a manual override as indicated at reference numeral 280 inFIG. 20. Moreover, all of the access by specific users may be filteredthrough various types of authentication as indicated in referencenumeral 282.

[0351] In a typical scenario, a user may enter an authentication module,such as on a workstation 304, illustrated in FIG. 20, to enable secureaccess to the system. Where the function performed by the user is one ofthe criteria considered for interfacing and access, the user may beprompted to enter a current function, or the function may be recognizedfor the individual user profile. In this matter, the same user may havemultiple functions in the system, such as in the case of thoracicradiologist at a hospital functioning as an interventionalist in onecontext and having additional functions as a mammographer at otherperiods, a manager at certain periods, and so forth. As a furtherexample, a general practice nurse may function as a clinician at certaintimes, such as to input medical history information, and as anappointment scheduler at other times, and as a clerical person for inputof billing, record data or insurance data at still other times. Eachindividual or institution, may customize one or more profiles containingpersonal preferences or information for each function. The profile maycontain data about the user, and information describing the userinterface preferences, if any, for different data access modes orfunctions.

[0352] Similarly, certain hardware or modality systems may have directaccess to the integrated knowledge base, such as for uploading ordownloading information useful in the analysis, processing, or dataacquisition functions performed by the system. As illustrated in FIG.20, such hardware, denoted generally by reference numeral 284, mayinclude imaging systems, patient input stations, general purpose ofcomputers linked via websites, and so forth. The hardware may interfacewith the parser by similar designation of one or more functions 286, ina matter similar to that described above for the users. Similarly,parameters such as the environment of the hardware, as indicated atreference numeral 288, may be considered. Such environments may providean indication, for example, of where and how a system is used, such asto differentiate specific functionalities of imaging systems used inemergency room settings from those used in other clinical applications,mobile settings, and so forth. As will be appreciated by those skilledin the art, such function and environment information may influence thetype and amount of data which can be accessed from or uploaded to theintegrated knowledge base, and may be used, for example, inprioritization or processing of information from the integratedknowledge base depending upon urgency of treatment, and so forth.

[0353] A general system input 290 is also illustrated in FIG. 20, whichmay be considered by the logical parser. General system information maybe relative to individual interfacing systems, including a system onwhich a user or piece of hardware interfaces with the knowledge base. Byway of example, a system utilized by a user to interface with theknowledge base may, automatically or with user intervention, provideinformation relating to specific hardware devices, parameters, systemcapabilities, functions of the device, environments in which the devicesare located or used, and so forth. Such information may indicate, forexample, that a device is used as an image review workstation, such thatdifferent default interface characteristics may be employed in aradiology reading room and in an intensive care unit. Such interfacecharacteristics may offer unique advantages, such as differentpresentation modes for similar data, customized resolution and bandwidthutilization, and so forth.

[0354] Based upon the information provided to the logical parser 272,the parser determines appropriate user interface definitions, as well asdefinitions of access to the integrated knowledge base. Among thedeterminations made by the logical parser 272, may be allowable datastate changes which can be initiated by the user, hardware or system,allowed methods and fields for data input and output, defined graphicalor other (e.g. audio) presentation modes, and so forth. In providingsuch definition, the logical parser may draw upon specific levels orclassifications of access, as well as upon specific pre-definedgraphical interfaces or other fields, which are utilized in formulatingthe interfaces. In particular, for a given knowledge base request, thelogical parser 272 may utilize algorithms embedded within the knowledgebase interface software, pre-defined sets of instructions from aninterface manager, or self-learning algorithms, in addition to suchpre-defined access and interface configurations. Where a user is allowedto manually override characteristic data or configurations, the logicalparser may customize the interface or given application or function. Forexample, an individual user may utilize a review workstation 304 in anintensive care unit to review a trauma case, but utilizing defaultemergency room settings by overriding the intensive care unit settings.A wide variety of other definitional functions and overrides may beenvisioned, all permitting standard and customized interfaces and accesslevels to the integrated knowledge base.

[0355] Among the functions defined by the logical parser are certainfunctions for defining the user interface, and other functions fordefining access to the integrated knowledge base. As illustrated in FIG.20, such functions may include a definition of allowed input fields, asillustrated at reference numeral 292. Such fields may, in the context ofa graphical user interface, be shown, not shown, or “grayed out” in aparticular user interface, depending upon the factors discussed above.In addition, allowed input modes, as indicated at reference numeral 294,may be defined, again allowing various types of input, such as throughthe display or non-display of specific input pages, interactive webpages, and so forth. Similarity, specific graphical interfaces may bedefined by the logical parser as indicated at reference numeral 296. Itshould be noted, that the various interface fields, modes, andpresentations identified by the logical parser based upon the inputinformation may be stored remotely, such as in the processing system orsystem data repository, or locally in a management system or within aworkstation 304 itself.

[0356] The logical parser may also define specific levels of interactionor access which are permitted between users, systems, and hardware onone hand, and the integrated knowledge base on the other. Such accesscontrol may define both the accessing of information from the knowledgebase, and the provision of information to the knowledge base. The accesscontrol may also define the permitted processing functions associatedwith the knowledge base via the data processing system. In the examplesillustrated in FIG. 20, such functions may include defining allowed datafor read access, as indicated at reference numeral 298, defining alloweddata for read-write access, as indicated at reference numeral 300, anddefining allowed data for write access, as indicated at referencenumeral 302.

[0357] As noted above, the interface processing system 268 permitsvarious types of authentication to be performed, particularly for usersattempting to gain access to the integrated knowledge base. Thisauthentication function may be achieved in a range of manners, includingby password comparisons, voice recognition, biometrics, script or filescontained within an interface device (e.g. a “cookie”) or password file,and so forth. Because a wide range of diverse data may be included inthe integrated knowledge base, authentication and security issues can bethe focus of specific software and devices to carefully guard access andavoid tampering or unauthorized access. Thus, in addition to the use ofstandard user authentication protocols, data encryption techniques forknowledge communicated to and from the knowledge base may be employed,and associated infrastructure may be offered at input sides and outputsides of the interface.

[0358] In general, a user may be responsible for setting the security oraccess level for data generated or administrated by that user, or otherparticipates may be responsible for such security and access control.Thus, the system can be programmed to implement default access levelsfor different types of users or user functions, as noted above.Moreover, different privacy levels may be set by a user for differentsituations and for other users. Specifically, a patient or primary carephysician may be in a best position to set access to his or her medicaldata, such that a specific set of physicians or institutions can accessthe information, depending upon their need. Access can also be broadenedto include other physicians and institutions, such as in the event ofaccident or incapacitation of a patient. Moreover, access levels can besorted by individual, situation, institution, and the like, withparticular access levels being implemented in particular situations,such as in case of emergency, for clinical visits, during a transfer ofcontrol or oversight to an alternative physician during periods of avacation, and so forth.

[0359] In general, the authentication and security procedures may beimplemented through software which may question a patient and implementdefaults based upon the responses. Thus, a patient may be prompted forclasses of individuals, insurance companies, primary care physicians andspecialists, kin, and the like, as well as for an indication of whatlevel of access is to be provided to each class. Parsing and access tothe information, as well as customization of the interfaces may thenfollow such designations.

[0360] Certain inherent advantages flow from the interface systemdescribed above. By way of example, an individual patient can become,effectively, a data or case manager granting access to information basedupon the patient's desires and objectives. The mechanism can also becustomized, and easily altered, for conformance with local, state andfederal or other laws or regulations, particularity those relating toaccess to patient data. Such regulations may also relate to access tobilling and financial information, access by employers, disabilityinformation, access to and for insurance claims, Medicare and Medicaidinformation, and so forth. Moreover, the technique offers automatic oreasily adapted compliance with hospital information system data accessregulations, such that data can be flagged to insure privacy based uponthe user or access method. Finally, the technique provides for rapid andconvenient setting, such as by the patient or a physician, of privacylevels for a broad range of users, such as by class, function,environment, and so forth.

[0361] Multi-Level System Architecture

[0362] As described generally above, the present techniques offer input,analysis, processing, output and general access to data at variouslevels, for various users, and for various needs. In particular, thesystem offers the capability of providing various levels of data accessand processing, with all of the various levels generally beingconsidered as contributing to, maintaining, or utilizing portions of theintegrated knowledge base and functionality described herein. Thevarious levels, rising from a patient or user level may includeworkstations, input devices, portions of the data processing system, andso forth which contribute the needed data and which extract needed datafor the functionality carried out at the corresponding level. Wherelevels in the system architecture can satisfy the users needs, such aswithin a specific institution, insurance company, department, region,and so forth, sharing and management of data may take place solely atsuch levels. Where, however, additional functionality, is desired, thesystem architecture offers for linking the lower and any intermediatelevels as necessary to accommodate such functionality.

[0363]FIGS. 21 and 22 generally illustrate exemplary architectures andmanagement functions carried out in accordance with such multi-levelarchitectures. FIG. 21 illustrates the present data exchange system 2 asincluding a number of integrated levels and clusters of input and outputstations or users. The users, which would typically be patients 4 orclinicians 6 (including radiologists, nurses, physicians, managementpersonnel, insurance companies, research institutions, and so forth)reside at fundamental or local level 306. As noted above, variousfunctionalities may be carried out at such local levels, includingtailoring of data input and output functions, access control, interfacecustomization, and so forth. Within a local group or cluster level 308,then, such users may communicate with one another and with systemelements of the type described above. That is, each local group orcluster level 308 may include any or all of the various resourcesdiscussed above, including both data resources and controllable andprescribable resources. In a practical implementation, a local group orcluster level 308 may include, by way of example, departments within aparticular institution, institutions affiliated in some way,institutions located in a specific geographical region, institutionslinked by virtue of their practice area or specialization, and so forth.The linking of the users and components at such local group or clusterlevels, then, permits specific functions to be carried out, to theextent possible, fairly locally and without the need to access remotedata resources or other local groups or clusters.

[0364] Similar remote groups or clusters may then be linked, and may besimilar or generally similar internal structures, as indicated atreference numerals 310, 312, and 314 in FIG. 21. It should be noted,however, that each of such clusters may vary widely in size, character,and even in its own network architecture, depending upon the needs andfunctions of the users within the group or cluster. The various localgroups and cluster levels, then, may be linked by one or more centralclusters as indicated generally at reference numeral 318.

[0365] Although a “centralized/decentralized” system architecture isgenerally illustrated in FIG. 21, it should also be borne in mind thatthe functionality of the multi-level system offered by aspects of thepresent technique may take on various analytical forms. That is, any orall of available network architectures, including centralizedarchitectures, ring structures, hierarchical structures, decentralizedstructures, centralized structures, and combinations of these may resideat the various levels in the overall system. Moreover, the variousremote groups or clusters may, where desired, be linked to one anotherin alternative fashions without necessarily passing through a centralgroup or cluster. Thus, preferential links between specific institutionsor practitioners may be provided such that a “virtual cluster” isdefined for the exchange of data and processing of data. Such links maybe particularly useful where special relationships or repetitiveoperations are carried out between such users.

[0366] The functions described above, including the data acquisition,processing, analysis, and other functions may be carried out at specificworkstations within the architecture of FIG. 21, within local groups orclusters, or by use of more expanded resources incorporating one or moreremote group or cluster. Certain of these functions, according to themulti-level architecture scenario, are generally illustrated in FIG. 22.As shown in FIG. 22, certain functions may be carried out at local groupor cluster levels 308, with generally similar functions being carriedout at higher levels 318. Again, it should be noted that the same orsimilar functions may even be carried out at an individual terminal orworkstation, and that further levels may be provided in thearchitecture.

[0367] As illustrated in FIG. 22, users 4, 6 may be linked to the systemand inputs and access filtered through a security/access control modules320. As noted above, such modules may employ various forms of securityand access control, such as based upon passwords, voice recognition,biometrics, and more sophisticated techniques. In general, the modules320 will maintain a desired level of assurance that those linking to thenetwork have rights to the specific data to be uploaded, downloaded, orprocessed. The modules 320 allow the users to gain access to a localknowledge base 322 which, from a general standpoint, may be consideredto be part of the integrated knowledge base discussed above. It shouldalso be noted that the local knowledge base 322 may also incorporatefeatures of a federated database as discussed above wherein certain datamay be pre-processed or translated for use by the programmedfunctionalities.

[0368] A validation or data management module 324 will typically beprovided in some form to control access to and quality of data withinthe local knowledge base 322 and data from the other components of theoverall system. That is, certain data, particularly that data which isused at a local level, may be preferential stored within the localknowledge base 322. However, where the overall system functionalityrequires, such data may be uploaded to higher levels, or to piers inother local groups or clusters. Similarly, data may be downloaded orprocessed from other remote sources. To maintain the validity andquality of such data, the validation and data management module 324 maycarry out specific functions, typically bi-directionally, as indicatedin FIG. 22. Such functions may include those of the reconciliationmodules as indicated at reference numeral 326, which can reconcile orvalidate certain data, such as based upon time of entry, source of thedata, or any other validating criteria. Where such reconciliation orvalidation is not available, such as due to conflicting updates orinputs, such matters may be flagged to a user for reconciliation. Asynchronizer module 328 provides, similarly, for synchronizing recordsbetween the local knowledge base 322 and remote resources. Finally, alink-upload/download module 330 provides for locating, accessing, andeither storing up or downloading from other memories or repositories forthe data from the local knowledge bases.

[0369] Generally similar functionality may be carried out, then, atother levels or within other relationships, as indicated generally by318 in FIG. 22. Thus, as between local groups or clusters, security andaccess control modules 332 may, in conjunction with modules 320, providesecure access to data from other users, groups, clusters or levels.Moreover, cluster knowledge base 334 may be maintained which compliment,or even replicate some of the local knowledge base data. As with thelocal knowledge base 322, the cluster knowledge base 334 may begenerally considered to be part of the overall integrated knowledgebase. Other functions may be performed at such higher levels as well.Thus, as indicated at reference numeral 336, validation and datamanagement modules may be implemented which, again, may be coordinatedwith the functionality of similar modules 324 at local levels. Suchmodules may, again, include reconciler modules 338, synchronizer modules340 and link/upload/download modules 342 which facilitate exchange ofdata between groups or clusters.

[0370] The multi-level architecture described above offers significantadvantages and functionalities. First, data may be readily accessed byspecific members of groups or clusters with specifically-tailored accesscontrol functions. That is, for such functions as insurance billing,clinical analysis, and so forth, reduced levels of securities may beprovided within a specific group or cluster. Access to data by otherusers in other groups or clusters, then, may be more regulated, such asby application of different security or access control mechanisms.Moreover, certain functionalities may be provided at very basic levels,such as at patient or clinician workstations, with additional access todata and processing capabilities being linked as necessary.

[0371] Moreover, it should be noted that in presently contemplatedembodiments, the overall network topology tends to mirror the underlyingdata structure which in itself mirrors and facilitates computer-assisteddata operation algorithms discussed below. That is, where functionalityor data are related by specific relationships, processing needs, accessneeds, validation needs, and so forth, the establishment of groups orclusters may follow similar structures. That is, as noted above,“typical” access, use, needs, and functionalities may reside at more orless tight nodes or clusters, with more distant or infrequent structuresor functionalities being more distributed.

[0372] The linking of various clusters or groups also permitfunctionalities to be carried out that were heretofore unavailable inexisting systems. For example, analysis for trends, relationships andthe like between data at various groups or cluster levels may befacilitated which can aid in identifying traditionally unavailableinformation. By way of example, where a specific prevalence level of adisease state occurs at a specific institution, department within aninstitution, or a geographic region, existing systems tend to notrecognize or belatedly recognize any relationship between suchoccurrence and similar occurrences in other locations. The presentsystem, on the other hand, permits such data to be operated upon, mined,analyzed, and associated so as to easily and quickly recognize thedevelopment of trends at various locations and even related by variousdata, such as quality of care, and so forth. Thus, coordinated accessand analysis of peer information is available for identification of suchdisease states in overall population.

[0373] Similarly, resource management may be improved by the multi-levelarchitecture offered by the present technique. In particular, trends,both past and anticipated in inventory use, insurance claims, humanresource needs, and so forth may also be identified based upon theavailability of data and processing resources at the various levelsdescribed above.

[0374] Patient-Oriented Medical Data Management

[0375] The present technique offers further advantages in the ability ofpatients to be informed and even manage their own respective medicalcare. As noted above, the system can be integrated in such a manner asto collect patient data prior to medical contacts, such as officevisits. The system also can be employed to solicit additionalinformation, where needed, for such interactions. Furthermore, thesystem can be adapted to allow specific individualized patient recordsto be maintained that may be controlled by the individual patient or apatient manager. FIG. 23 generally represents aspects of the techniquedesigned for creation and management of integrated patient records.

[0376] As shown in FIG. 23, the arrangement of functionalities andmodules may be referred to generally as a patient-management knowledgebase system 344, which at least partially includes features of theintegrated knowledge base and other techniques described above. Apatient 4 provides patient data, as indicated generally at referencenumeral 346 in FIG. 23. The patient data may be provided in any suitablemanner, such as via hard copies, analysis of tissue samples, inputdevices at institutions or clinics, or input devices which areindividualized for the patient. Such input devices may include, forexample, devices which are provided to, worn by, implanted in, ordirectly implemented by the patient as at the patient's home or place ofemployment. Thus, the patient data 346 may be provided by mobilesamplers (e.g. for blood analysis), sensing systems for physiologicaldata (e.g. blood pressure, heart rate, etc.). The patient data may bestored locally, such as within the sensing device or within a patientcomputer or workstation. Similarly, the patient data may be providedeither at the prompting of the patient or through system prompting, suchas via accessible Internet web pages. Further, patient data may beextracted from external resources, including the resources of theintegrated knowledge base as described more fully below. Thus, thepatient data, in implementation, may be exchanged in a bi-directionalfashion such that the patient may provide information to the record andaccess information from the record. Similarly, the patient may manageinput to the record of data from outside resources as well as manageaccess to output of the record to outside resources.

[0377] The patient data is exchanged with other element of the systemvia a patient network interface 348. The patient network interface maybe as simple as a web browser, or may include more sophisticatedmanagement tools that control access to, validation of, and exchange ofdata between the patient and the outside resources. The patient networkinterface may communicate with a variety of other components, such asdirectly with care providers as indicated at reference numeral 350. Suchcare providers may include primary care physicians, but may also includeinstitutions and offices that store patient clinical data, andinstitutions that store non-clinical data such as insurance claims,financial resource data, and so forth. The patient network interface 348may further communicate with reference data repository 352. Suchreference data repositories were discussed above with general referenceto the integrated knowledge base. The repositories 352 may be the sameor other repositories, and may be useful by the patient networkinterface for certain processing functions carried out by the interface,such as comparison of patient data to known ranges or demographicinformation, integration into patient-displayed interface pages ofbackground and specific information relating to disease states, care,diagnoses and prognoses, and so forth. The patient network interface 348where necessary, may further communicate with a translator or processingmodule as indicated generally at reference numeral 354. The translatorand processing modules may completely or partially transform theaccessed data or the patient data for analysis and storage. Again, thetranslator and processing functions may be bi-directional such that theymay translate and process both data originating from the patient anddata transferred to the patient from outside resources.

[0378] An integrated patient record module 356 is designed to generatean integrated patient record, as represented generally by referencenumeral 362 in FIG. 23. As used in the present context, the integratedpatient record may include a wide range of information, both acquireddirectly from the patient, as well as acquired from institutions whichprovide care to the patient. The record may also include data derivedfrom such data, such as resulting from analysis of raw patient data,image data, and the like both by automated techniques and by human careproviders, where appropriate. Similarly, the integrated patient recordmay include information incorporated from reference data repositories352. The integrated patient record module preferably stores some or allof the integrated patient record 362 in one or more data repository 358.

[0379] As noted above, the system 344 permits creation of an integratedpatient record 362 which may include a wide range of patient data. Inpractice, the integrated patient record, or portions of the patientrecord, may be stored at various locations, such as at a patientlocation as indicated adjacent to the patient data block 346, atindividual care providers (e.g. with a primary care physician) asindicated adjacent to block 350, or within a data repository 358accessed by the integrated patient record module 356. It should also benoted that some or all of the functionality provided by the patientnetwork interface 348, the translator and processing module 354 and theintegrated patient record module 356 may be local or remote to thepatient. That is, software for carrying out the creation and maintenanceof the patient record may be stored direct at a patient terminal, or maybe fully or partially provided remotely, such as through a subscriptionservice. Similarly, the patient record repository 358 may be local orremote from the patient.

[0380] The integrated patient record module 356 also is preferablydesigned to communicate with the integrated knowledge base 12 via anintegrated knowledge base interface 360. The interface 360 may conformto the general functionalities described above with respect to access,validation, tailoring for patient needs or uses, and so forth. Theintegrated knowledge base interface 360 permits the extraction ofinformation from resources 18, which may be internal to specificinstitutions as indicated in FIG. 23. The interface also permits datafrom the patient to be uploaded to such resources and institutions. Asalso noted in FIG. 23, the integrated patient record 356, fully or inpart, may be stored generally within the integrated knowledge base 12 tofacilitate access by care providers, for example. The record may also bestored within individual institutions, such as within a hospital orclinic which has or will provide specific patient care.

[0381] The system functionality illustrated in FIG. 23 offerssignificant advantages. By way of example, as noted above, the access tospecific information and the creation of records may be controlled andregulated more directly by a patient. That is, the system serves as anenabler for empowering the patient with respect to proactive managementof medical records. Such interaction may take the form ofpatient-controlled access to portions of the patient record provided tospecific care providers. Similarly, the system offers the potential forimproving the education of the patient as regards to general questionsas well as specific clinical and non-clinical issues. The system alsoprovides a powerful tool for accessing patient data, including raw data,processed data, links, updates, and so forth which may be used by careproviders for identifying and tracking patient conditions, schedulingpatient care visits, and so forth. Such functions may be provided by“push” or “pull” exchange techniques, such as on a timed basis, orthrough notifications, electronic messages, wireless messages, and soforth. Direct interaction with the patient may include, therefore,uploading of patient data, downloading of patient data, prescriptionreminders, office visit reminders, screening communications, and soforth. Moreover, the integration of the patient data with otherfunctionality and data from other resources permits the integratedpatient record to be created and stored periodically or in advance ofspecific needs by the patient or by an institution, or compiled at thetime of a specific query by linking to and accessing data for responseto the query.

[0382] Predictive Modeling

[0383] The present technique, by virtue of the high degree ofintegration of the data storage, access and processing functionsdescribed above, provides a powerful tool for development of predictivemodels, both clinical and non-clinical in nature. In particular, datacan be drawn from the various resources in the integrated knowledge baseor a federated data base, processed, and analyzed to improve patientcare by virtue of predictive model development. The development of suchpredictive models can be fully or partially automated, and such modelingmay serve to adapt certain computer-assisted functions of the typesdescribed above.

[0384]FIGS. 24 and 25 generally illustrate aspects of predictive modeldevelopment which may be implemented in accordance with aspects of thepresent technique. FIG. 24 represents a predictive modeling system 364that may be built upon or compliment the integrated knowledge base andnetwork functions described above. The predictive modeling system 364draws upon the resources 18, both data resources and controllable andprescribable resources, as well as upon any federated databases 14provided in the system and upon the integrated knowledge base 12, whichagain may be centralized or distributed in nature. The system 364 reliesupon software identified in FIG. 24 as data mining and analysis modules366 designed to extract data from the various resources, knowledge basesand databases, and to identify relationships between the data useful indeveloping predictive models. The analysis performed by the data miningand analysis modules 366 may be initiated in any suitable manner, asindicated by the initiators block 368 in FIG. 24, including any or allof the initiating events outlined above with reference to FIG. 18. Onceprocessing is initiated, the modules search for and identify data whichmay be linked to specific disease states, medical events, or to yetunidentified or unrecognized disease states or medical events. Moreover,the modules may similarly seek non-clinical data for development ofsimilar models, such as for prediction of resource needs, resourceallocation, insurance rates, financial planning, and so forth. It shouldbe noted that the data mining and analysis functions performed by themodules 366 may operate on “raw” data from the resources and databases(again both clinical and non-clinical), as well as on filtered,validated, reduced-dimension, and similarly processed data from any oneof these resources. Moreover, initiation of such processing, orvalidation of data may be provided by an expert, such as a clinicianrepresented at reference numeral 6 in FIG. 24.

[0385] Based upon the mining an analysis performed by modules 366, apredictive model development module 370 further acts to convert the dataand analysis into a representative model that can be used fordiagnostic, planning, and other purposes. In the clinical context, awide range of model types may be developed, particularly for refinementof computer-assisted processes referred to above. As noted above, theseprocesses, referred to here in as CAX processes, permit powerfulcomputer-assisted work flow such as for acquisition, processing,analysis, diagnostics, and so forth. The methodologies employed by thepredictive model development module 370 may vary depending upon theapplication, the data available, and the desired output. In presentlycontemplated embodiments, for example, the processing may be based uponregression analysis, decision trees, clustering algorithms, neuralnetwork structures, expert systems, and so forth. Moreover, thepredictive model development module may target a specific disease stateor medical condition or event, or may be non-condition specific. Wheredata is known to relate to a specific medical condition, for example,the model may consist in refinement of rules and procedures used toidentify the likelihood of occurrence of such conditions based upon allavailable information from the resources and knowledge base. Moregenerally, however, the data mining and analysis functions, inconjunction with the model development algorithms, may provide foridentification of disease states and relationships between these diseasestates and available data which were not previously recognized.

[0386] In applications where the predictive model development module 370is adapted for refinement of a computer-assisted process CAX, the modelmay identify or refine parameters useful in carrying out such processes.The output of the module 370 may therefore consist of one or moreparameters identified as relating to a specific condition, event ordiagnosis. Outputs from the predictive model development module 370,typically in the form of data relationships, may then be further refinedor mapped onto parameters available to and used by the CAX processes 85illustrated in FIG. 24. In a presently contemplated embodiment,therefore, a parameter refinement function 372 is provided whereinparameters utilized in the CAX processes 85 are identified, as indicatedat reference numeral 374, and “best” or optimized values or ranges ofthe values are identified or as indicated at reference numeral 376. Theparameters and their values or ranges are then supplied to the CAXprocess algorithms for future use in the specific process. As a generalrule, the CAX processes produce some output as indicated at referencenumeral 378.

[0387] It should be noted that various functions performed and describedabove in the predictive modeling system 364 may be performed on one ormore processing systems, and based upon various input data. Thus, asmentioned above, the integrated knowledge base and therefore the dataavailable for predictive model development is inherently expandable suchthat models may be developed differently or enhanced as improved oradditional information is available. It should also be noted that thevarious components of the system illustrated in FIG. 24 provide forhighly interactive model development. That is, various modules andfunctions may influence one another to further improve modeldevelopment.

[0388] By way of example, where a predictive model is developed bymodule 370 based upon specific data mining, the model development modulemay identify that additional or complimentary data would also be usefulin improving the performance of the CAX processes. The model developmentmodule may then influence the data mining and analysis function basedupon such insights. Similarly, the identification of parameters andparameter optimization carried out in the parameter refinement processcan influence the predictive model development module. Furthermore, theresults of the CAX process 85 can similarly affect the predictive modeldevelopment module, such as for development or refinement of other CAXprocesses.

[0389] The latter possibility of interaction between the components andfunctions illustrated in FIG. 24 is particularly powerful. Inparticular, it should be recognized that the predictive modeldevelopment module 370 may, in some respects, itself serve as a CAXprocess 85, such as for recognizing relationships between available dataand matching such relationships to potential disease states, events,resource needs, financial considerations, and so forth. The process isnot limited to any particular CAX process, however. Rather, althoughmodel development may focus on the diagnosis of a disease state, forexample, the output of the CAX process (e.g. computer-assisted diagnosisor detection) may give rise to improvements in processing and modelingof desired processing of data. Similarly, the results of the CAX processin processing may lead to recognition of improvements in a modelimplemented for computer-assisted acquisition (CAA) of data. Othercomputer-assisted processes, including computer-assisted assessment(CAAx) of health or financial states, prognoses, prescriptions, therapy,and other decisions may similarly be impacted both by the predictivemodel development module, and by feedback from refined other processes.

[0390] As illustrated in FIG. 24, certain steps involved in developmentof clinical and non-clinical predictive models may be subject tovalidation or input from elements of the system or from experts. Thus,the CAX output 378 would typically be reviewed by an expert 6.Similarly, CAX output which may influence the predictive modeldevelopment module 370 is preferably subject to validation as indicatedat block 380 in FIG. 24. Such validation may be performed by the systemitself (such as by cross-checking data or algorithm output, or by one ormore experts). The output of the validation may then be linked to theresources, including the original resources themselves 18, and theintegrated knowledge base 12. For example, it may be useful to link orpre-process certain data, or flag certain data for use in the CAXprocesses implemented by the developed model.

[0391] In use, the developed or improved model will typically beavailable for remote processing or may be downloaded to systems,including computer systems, medical diagnostic imaging equipment, and soforth, which employ the model for improving data acquisition,processing, diagnosis, decision support, or any of the other functionsserved by the CAX process. During such implementation, and as describedabove, the implementing system may access the integrated knowledge base,the federated database, or the originating resources themselves toextract the data needed for the CAX process.

[0392] Within the predictive model development module 370 severalfunctions may be resident and carried out either on a routine basis oras specifically programmed or initiated by a user or by the system. FIG.25 illustrates an example of certain of these processes carried out bythe model development module. As shown in FIG. 25, based upon data minedand analyzed (i.e. acquired or extracted from the resources), the modulewill typically identify relationships between available data asindicated at block 382 of FIG. 25. The relationships may be based uponknown interactions between the data, or based upon identificationalgorithms as noted above (e.g. regression analysis, decision trees,clustering algorithms, neural networks, expert input, etc.). Moreover,it should be noted that the relationship identification may be based onany available data. That is, the data may be most usefully employed inthe system when considered separate from its type, modality, practicearea, and so forth. By way of example, clinical data may be employedfrom imaging systems and used in conjunction with demographicinformation and with histological information on a particular patient.The data may also incorporate non-patient specific (e.g. generalpopulation) data which may be further indicative of risk or likelihoodof a particular disease state, and so forth. Based upon the identifiedrelationships, rule identification is carried out as indicated at block384. Such rules may include comparisons, Boolean relationships,regression equations, and so forth used to link the various items ofdata or input in the identified relationships.

[0393] Input refinement steps are carried out as indicated at block 386in which the relationships are linked to various data inputs which areavailable from the resources or database or knowledge base. As noted inFIG. 25, such inputs 388 may be non-parametric, that is, relate to rawor processed data which is not specifically influenced by settings orparameters of the CAX process. Other input identification, as indicatedat block 390, is targeted to parametric inputs which can be impacted byalteration of the CAX process. Based upon the input identification, therule identification and the relationship identification, reconciliationand refinement of the model is possible as indicated at block 392.Again, such reconciliation and refinement may include addition ordeletion of certain inputs, placement of certain conditions on inclusionof inputs, weighting of some inputs, and so forth. Such reconciliationand refinement may be carried out by the system or with input from anexpert as indicated at reference numeral 6 in FIG. 25. The entireprocess, then, may be somewhat iterative as indicated by the returnarrows in FIG. 25, such that the reconciliation and refinement processmay further impact identification of relationships, rules and inputs.

[0394] A wide range of models may be developed by the foregoingtechniques. In a clinical context for example, different types of dataas described above maybe accessible to the CAX algorithms, such as imagedata, demographic data, and non-patient specific data. By way ofexample, a model may be developed for diagnosing breast cancer in womenresiding in a specific region of a country during a specific period ofyears known to indicate an elevated risk of such conditions. Additionalfactors that may be considered where available, could be patient historyas extracted from questionnaires completed by the patient (e.g. smokinghabits, dietary habits, etc.).

[0395] As a further example, and illustrating the interaction betweenthe various processes, a model for acquiring data or processing data maybe influenced by a computer-assisted diagnosis (CADx) algorithm. In oneexample, for example, the output from a therapy algorithm withhighlighting of abdominal images derived from scanned data may bealtered based upon a computer-assisted diagnosis. Therefore, the imagedata may be acquired or processed in relatively thin slices for a lowerabdomen region where the therapy algorithm called for an appendectomy.The rest of the data may be processed in a normal way with thickerslices. Thus, not only can the CAX algorithms of different focusinfluence one another in development and refinement of the predictivemodels, but data of different types and from different modalities can beused to improve the models for identification and treatment of diseases,as well as for non-clinical purposes.

[0396] Algorithm and Professional Training

[0397] As noted above, a number of computer-assisted algorithms may beimplemented in the present technique. Such algorithms, generallyreferred to herein as CAX algorithms, may include processing andanalysis of a number of types of data, such as medical diagnostic imagedata. The present techniques offer enhanced utility in refining suchprocesses as described above, and for refining the processes through alearning or training process to enhance detection, segmentation,classification and other functions carried out by such processes. Thepresent techniques also offer the potential for providing feedback, suchas for training purposes, of medical professionals at various levels,including radiologists, physicians, technicians, clinicians, nurses, andso forth. FIG. 26 illustrates exemplary steps in such a training processboth for an algorithm and for a medical professional.

[0398] Referring to FIG. 26, an algorithm and professional trainingprocess 394 is illustrated diagrammatically. The process may includeseparate, although interdependent modes, such as a professional trainingmode 396 and an algorithm training mode 398. In general, both modes maybe programmed and functioned in one or more operating environments, withthe actual functionality performed varying depending upon how the useris currently implementing the process.

[0399] In general, the process provides for interaction betweencomputer-assisted algorithms, such as a CAD algorithm, and functionsperformed by a medical professional. The process will be explainedherein in context of a CAD program used to detect and classify featuresin medical diagnostic image data. However, it should be borne in mindthat similar processes can be implemented for other CAX algorithms, andon different types of medical diagnostic data, including data fromdifferent modalities and resource types.

[0400] The process 394 may be considered to begin at a step 400 where anexpert or medical professional performs feature detection andclassification. As will be recognized by those skilled in the art, suchfunctions are typically performed as part of a diagnostic image readingprocess, beginning typically with a reconstructed image or a set ofimages in an examination sequence. The expert will typically draw thedata from the integrated knowledge base 12 or from the various resources18 and may draw upon additional data from such resources to support the“reading” process of feature detection and classification. The expertthen produces a dataset labeled D1, and referred to in FIG. 26 byreference numeral 402, which may be an annotated medical diagnosticimage in a particular application. Any suitable technique can be usedfor producing the dataset, such as conventional annotation, dictation,interactive marking, and similar techniques.

[0401] In parallel with the expert feature detection and classificationfunctions, an algorithm, in the example a CAD algorithm, performssimilar feature detection and classification functions at step 404. Asnoted above, various programs are available for such functions,typically drawing upon raw or processed image data, and identifyingsegmenting and classifying identified features in accordance withparametric settings. Such settings may include mathematically orlogically-defined feature recognition steps, intensity or color-basedfeature detection, automated or semi-automated feature segmentation, andclassification based upon comparisons of identified and segmentedfeatures with known characteristics of identified pathologies. As aresult of step 404, a second dataset D2, referred to in FIG. 26 byreference numeral 406, is produced, which may be similarly annotated fordisplay.

[0402] The expert-produced dataset 402 is subjected to verification bythe same or a different computer algorithm at step 408. The algorithmverification step 408 is illustrated in broken lines in FIG. 26 due tothe optional nature of this step when the system is operating inalgorithm training mode. That is, the algorithm verification of theexpert reading is preferred where feedback is provided to the expert asdescribed below. Alternatively, the algorithm verification step may beimplemented in all cases, such that a subsequently processed datasetincludes both the reading by the expert and by the algorithm and thefiltering of the expert-identified and classified features as producedby the algorithm verification step. In general, the algorithmverification step will serve to eliminate false positive readings asproduced by the expert. It should also be noted that a particularalgorithm and/or the parametric settings employed by the algorithm atstep 408 may be different from those used in step 404. That is, thealgorithm verification step may be performed by a different algorithm,or with different parametric settings, so as to provide a more or lessstringent filter at step 408 than was applied for the algorithm featuredetection and classification at step 404. Step 408 results in a furtherrefined. dataset D3, referred to in FIG. 26 by reference numeral 410,which may constitute a reconstructed image, annotated to indicate, wheredesired, both the expert feature detection and classification results,and changes in such results as result of the algorithm verification.

[0403] Similarly, the dataset 406 resulting from the algorithm featuredetection and classification is subjected to expert verification at step412. As with step 408, step 412 may be an optional step, particularlywhere the system functions in professional training mode. That is, wherefeedback is intended to be provided to the medical professional orexpert, the step may be eliminated so as to provide comparison of thealgorithm feature detection and classification with that produced by themedical professional. It should also be noted that a particular expertand/or the decision thresholds employed by the expert at step 412 may bedifferent from those used in step 400. The resulting dataset D4,referred to in FIG. 26 by reference numeral 414, again, may bereconstructed, when the data represents images, and may be annotated toindicate features identified by the algorithm and the changes made tosuch identification or classification by the expert or medicalprofessional.

[0404] In a present implementation, the datasets 410 and 414 are joinedin a union dataset 416, which may again comprise of one or more imagesdisplaying the origin of particular features detected and classified,along with changes made by either the algorithm or the expert duringverification. Block 418 in FIG. 26 represents a reconciler which may bea medical professional (the same or a different medical professionalthan carrying out the feature detection and classification orverification), or the reconciler may include automated or semi-automatedprocessing. The purpose of the reconciler 418 is to resolve conflictsbetween detection and classification by the algorithm and the expert,along with such conflicts that may result from modifications followingthe verification at steps 408 and 412.

[0405] Once the reconciler has acted upon the dataset D5, referred to inFIG. 26 by reference numeral 416, in an algorithm training mode 398,changes made by the expert verification at step 412 and by thereconciler 418 are analyzed as indicated at step 420. The analysis mayconsist of comparing the changes made and determining why the changeswere necessitated. As will be appreciated by those skilled in the art,CAX processing typically includes various settings which can be alteredto change the feature identification, detection, segmentation, andclassification that may have been performed.. The analysis performed atstep 420, then, can be directed to identifying how such parametricinputs can be modified to permit the results of the verification andreconciliation to conform. It should be noted, however, the analysisperformed at step 420 may not necessarily imply that a change in thealgorithm is needed to desired. That is, in certain situations it may bedesirable that the algorithm not produce exactly the same results as theexpert, in order to enhance the “second reader” or “independent firstreader” nature of the algorithm functions. At step 422, then, validationof any possible changes to the algorithm are made, such as by an expertor a team of experts. Where the validation step results in a conclusionthat a change in the algorithm may be in order, such modification may beimplemented as indicated at step 424. While reference is made in thepresent process to parametric modification of such algorithms, it shouldalso be noted that such modifications may include identification andconsideration of other inputs, such as inputs available from theintegrated knowledge base 12, as discussed above with reference to FIG.24.

[0406] When operating in a professional training mode 396, similaranalysis of the dataset 416 can be made as indicated at step 426 in FIG.26. Such analysis, again, may be intended to determine why changes inthe expert reading were made by the algorithm in the verification 408,and how such performance can be brought into conformity. Based upon suchanalysis, at step 428 the results may be reported and instructionprovided for the medical professional. It should be noted that suchreporting and instruction may simply provide feedback for the medicalprofessional, such as to indicate changes that would have been made tothe dataset 402 by algorithm verification. However, the reports orinstruction may also provide useful didactic input, references toteaching materials, samples, image-based data retrieval, and so forth,such that the medical professional is apprised of relevantconsiderations for improvement of performance.

[0407] Following creation of the dataset 416, results may be reportedand displayed in a conventional manner as indicated at step 430.Moreover, and optionally, other processes may be performed on theresulting data which may similarly provide assistance in refining eitherthe CAX algorithm or teaching the medical professional. Such processesare illustrated in FIG. 26 at reference numerals 432 and 434.

[0408] It should be noted that the foregoing processes can beimplemented as normal operating procedures, where desired. That is,complimentary algorithm and expert reading procedures, withcomplimentary algorithm and expert verification procedures, and with theuse of a reconciler, may be employed for regular handling of data fordiagnostic and other purposes. In a professional training mode, however,a relatively “heavy” filter may be used at the algorithm verificationstep, such as to identify more positive reads as potential falsepositive reads for training purposes. A different or “lighter” filtermay be used during normal operation and for the algorithm featuredetection classification formed at step 404. In addition, the analysisperformed either at step 420 or at 426 may further rely upon theintegrated knowledge base to identify trends, prognoses, and so forthbased upon both patient-specific data, non-patient specific data,temporal data of both a patient-specific and non-patient specificnature, and so forth. It should also be noted that, as discussed above,various changes can be made to the CAX algorithms as a result of thetraining operations. Such changes may include changes in processing, andmay be “patient-specific”, with such changes being stored for futureanalysis of data relating to the same patient. That is, for example, forimage data relating to a patient with certain anatomical characteristics(e.g. weight, bone mass, size, implants, prosthesis, etc.), thealgorithm may be specifically tailored for the patient by alteringparametric settings to enhance the utility of future application of thealgorithm and future correction or suggestions made to expert readingsbased upon the determinations made by the algorithm. In addition,changes can also be made to the integrated knowledge base itself basedupon the learning mode outcome, such as to adjust “normal ranges” withinthe data stored in the knowledge base.

[0409] In Vitro Characteristic Identification

[0410] As noted above, among the many resources and types of resourcesavailable for the present technique, certain resources will produce dataor samples which may be subject to in vitro data acquisition andanalysis. The present techniques offer a particularly useful tool in theprocessing of such data and samples for several reasons. First, thesamples may be analyzed based upon input of data of multiple types ofresources. Various computer-assisted processes, including dataacquisition, content-based information retrieval, processing andanalyzing of retrieved and/or acquired data, identification ofcharacteristics, and classification of data based upon identifiedcharacteristics may be implemented. Moreover, temporal analysis may beperformed to analyze characteristics of in vitro samples as they relateto previously-identified characteristics using known data, such as fromthe integrated knowledge base. The information retrieval processes mayfurthermore be based upon specific attributes of the in vitro sample,such as spatial attributes (e.g. size of specific components orcharacteristics), temporal attributes (e.g. change in features overtime), or spectral attributes (e.g. energy level, intensity, color,etc.). Such content, also identified, where possible, from informationstored in the integrated knowledge base, may include biomarkers, images,relationship tables, standardized matrixes, and so forth. Thus, multipleattributes may be used to enhance the acquisition, processing andanalysis of in vitro samples through reference to available data,particularly information in the integrated knowledge base.

[0411]FIG. 27 generally represents steps in processing of an in vitrosample in accordance with such improved techniques. The in vitrocharacteristic identification process, generally represented byreference numeral 436 in FIG. 27, begins at step 438 where the in vitrodiagnostics sample is acquired. As noted above, any suitable techniquecan be used for acquiring the sample, which may typically include bodyfluids, tissues, and so forth. At step 440 an analysis is performed onthe acquired sample. The analysis is informed by input from theintegrated knowledge base as indicated at block 442. The input mayinclude data relating to other modalities, resource types, or temporaldata relating to similar samples from the patient. The analysisperformed at step 440 may include certain comparisons with such data andmay be somewhat preliminary in nature. Thus, without departing from theacquisition step in the overall process, the sample acquisition may betailored to the needs of the process as indicated at step 444. Suchtailoring may include acquisition of other samples, acquisitions ofsamples under specific conditions (e.g. later in time during an officevisit, during patient activity or rest periods, from other regions ofthe body, and so forth). Thus, the in vitro diagnostics sampleacquisition process may be improved by computer analysis that influencesthe acquisition of the sample itself.

[0412] Following acquisition of the sample, processing of the sample maybe performed at step 446. The processing performed at step 446, ratherthan data processing, is typically sample processing to condition thesample for extraction of data either manually or in a semi-automated orfully-automated process. Following the processing at step 446, resultsof the processing are analyzed at step 448. As before, the analysisperformed at step 448 may include consideration of data from theintegrated knowledge base, including data from other modalities,resource types, and times. As with the analysis performed at step 440,the analysis at step 448 may be preliminary in nature, or furtheranalysis may be performed by tailoring the processing as indicated atstep 452. Thus, prior to final analysis of an in vitro diagnosticsample, additional processing may be in order, such as slidepreparation, analysis for the presence of various chemicals, tissues,pathogens, and so forth.

[0413] At step 454 results of the analysis are compared to knownprofiles, such as from the integrated knowledge base, to determinepossible diagnoses. As before, the comparisons made at step 454 may bebased upon data from different modalities, resource types and times. Thecomparisons may result in classification of certain data indicative ofdisease states, medical events, and so forth as indicated at step 458.The comparison and classification may further indicate that a specificpatient (or a population of patients) is undergoing certain trends thatmay be indicative of potential diagnoses, prognoses, and so forth. Theresults of the classification made at step 458 may be validated, such asby a medical professional, at step 460.

[0414] In general, for the present purposes, quantifiable signs,symptoms and/or analytes (e.g. chemicals, tissues, etc.) in biologicalspecimens characteristic of a particular disease or predisposition for adisease state or condition may be referred to as “biomarkers” for thedisease or condition. While reference has been made hereinto analysisand comparison in general, such biomarkers may include a wide range offeatures, including the spatial, temporal and spectral attributesmentioned above, but also including genetic markers (e.g. the presenceor absence of specific genes), and so forth.

[0415] By way of example, in a typical application, a patient's tissuewill be sampled and transmitted to a laboratory for analysis. Thelaboratory acquires the data with computer assistance using appropriatedetectors, such as microscopes, fluorescent probes, micro arrays, and soforth. The data contents, such as biomarkers, image signals, and soforth are processed and analyzed. As noted above, the acquisition andprocessing steps themselves may influenced by the reference to otherdata, such as from the integrated knowledge base. Therefore, such datais retrieved from the knowledge base for assisting in the acquisition,analysis, comparison and classification steps.

[0416] The comparisons made in the process may be parametric in natureor non-parametric. That is, as noted above, parametric comparisons maybe based upon measured quantities and parameters where characteristicsare indexed or referenced in parameter space and comparisons areperformed in terms of relative similarity of one dataset to another withrespect to certain indices, such as a Euclidean distance measure betweentwo feature set vectors. Such indices may include, in the example ofmicroscopy, characteristic cell structures, colors, reagent, indices,and so forth. Other examples may include genetic composition, presenceor absence of specific genes or gene sequences, and so forth.

[0417] Non-parametric comparisons include comparisons made withoutspecific references to indices, such as for a particular patient over aperiod of time. Such comparisons may be based upon the data contents ofone dataset that is compared for similarity to characteristics from thedata contents of another dataset. As will be noted by those skilled inthe art, one or both of such comparisons may be performed, and incertain situations one of the comparisons may be preferred over theother. The parametric approach is typically used when a comparison is tobe made between a given specimen and a different specimen with knowncharacteristics, such as based upon information from the integratedknowledge base. For example, in addition to deriving textures and shapepatterns of cells in a histopathology image, parameters may also bederived from demographic data, electrical diagnostic data, imagingdiagnostic data, and concentrations of biomarkers in biological fluid ora combination of these. Thus, the comparisons can be made based upondata from different modalities and different resource types, as notedabove. Non-parametric comparisons may generally be made, again, fortemporal comparison purposes. By way of example, a specimen may exhibitspecific ion concentrations dynamically changing and temporal variationsof data attributes (e.g. values, ratios of values, etc.) may need to beanalyzed to arrive at a final clinical decision.

[0418] Computer-Assisted Data Operating Algorithms

[0419] As noted above, the present technique provides for a high levelof integration of operations in computer-assisted data operatingalgorithms. As also noted above, certain such algorithms have beendeveloped and are in relatively limited use in various fields, such asfor computer-assisted detection or diagnosis of disease,computer-assisted processing or acquisition of data, and so forth. Inthe present technique, however, an advanced level of integration andinteroperability is afforded by interactions between algorithms both intheir development, as discussed above with regards to model development,and in their use. Moreover, such algorithms may be envisaged for bothclinical and non-clinical applications. Clinical applications include arange of data analysis, processing, acquisition, and other techniques asdiscussed in further detail below, while non-clinical applications mayinclude various types of resource management, financial analysis,insurance claim processing, and so forth.

[0420]FIG. 28 provides an overview of interoperability between suchalgorithms, referred to generally in a present context ascomputer-assisted data operating algorithms or CAX. As noted above, CAXalgorithms in the present context may be built upon algorithms presentlyin use, or may be modified or entirely constructed on the basis of theadditional data resources, integration of such data resources, orinteroperability between such resources in the algorithms and betweenthe algorithms themselves as discussed throughout the presentdescription. In the overview of FIG. 28, for example, an overall CAXsystem 462 is illustrated as including a wide range of steps, processesor modules which may be included in a fully integrated system. As notedabove, more limited implementations may also be envisaged in which someor a few only of such processes, functions or modules are present.Moreover, in a presently contemplated embodiment, such CAX systems areimplemented in the context of integrated knowledge basis such thatinformation can be gleaned to permit adaptation and optimization of boththe algorithms themselves and the data managed in the algorithms. Suchdevelopment and optimization may be carried out, as noted above, throughthe model development modules described herein, and various aspects ofthe individual CAX algorithms may be altered, including rules orprocesses implemented in the algorithms, as well as various settings.More will be said about such aspects of the CAX algorithms below withregards to FIG. 29.

[0421] As summarized in FIG. 28, in general, the CAX algorithms begin ata step 464 in which data is acquired. As noted throughout the presentdiscussion, the acquisition of data may take many forms, particularlydepending upon the resource type and the resource modality providing thedata. Thus, data may be input manually, such as from forms orconventional terminals, or data may be acquired through laboratoryreporting techniques, imaging systems, automatic or manual physiologicalparameter acquisition systems, and so forth. The data is typicallystored in one or more memory devices as discussed above, some of whichmay be incorporated in the data acquisition systems themselves, such asin imaging systems, picture archiving systems, and so forth.

[0422] At step 466 data of interest or utility for the functions carriedout by the CAX algorithm is accessed. A series of operations may then beperformed on the accessed data as indicated generally at referencenumeral 468. Throughout such processing, and indeed at step 466, theintegrated knowledge base 12, in full or in part, may be accessed toextract data, validate data, synchronize data, download data or uploaddata during the functioning of the CAX algorithm.

[0423] While many such computer-assisted data operating algorithms maybe envisaged, at present, some ten such algorithms are anticipated forcarrying out specific functions, again both clinical and non-clinical.Summarized in FIG. 28, therefore, are steps in algorithms forcomputer-assisted detection of features (CAD), and algorithms forcomputer aided diagnosis of medical conditions (CADx). Further,computer-assisted clinical decision algorithms (CADs) are implemented inwhich clinical decisions are automatically made based upon analysis andprocessing. Similarly, therapeutic or treatment decisions may beimplemented through additional routines (CATx). Specificcomputer-assisted acquisition (CAA) and computer-assisted processing(CAP) algorithms may be implemented of type described in detail above.Further, computer-assisted analysis (CAAn) algorithms may be implementedas discussed below. Computer-assisted prediction or prognosis (CAPX)algorithms are also envisaged in a medical context, as are prescriptionvalidation, recommendation or processing algorithms (CARx). Finally,computer-assisted assessment (CAAx) algorithms are envisaged for a rangeof conditions, both clinical and non-clinical.

[0424] Considering in further detail the data operating steps summarizedin FIG. 28, at step 470 accessed data is generally processed, such asfor digital filtering, conditioning of data, adaptation of dynamicranges, association of data, and so forth. As will be appreciated boththose skilled in the art, the particular processing carried out in step470 will depend upon the type of data being analyzed in the type ofanalysis or functions being performed. It should be noted, however, thatdata may be processed from any of the resources discussed above, andindeed data from more than one modality or even type of resource may beprocessed, such as for complex analysis of the presence risk, ortreatment of medical conditions, and so forth. At step 472, similarly,analysis of the data is performed. Again, such analysis will depend uponthe nature of the data and the nature of the algorithm on which theanalysis is performed.

[0425] Following such processing and analysis, at step 474 features ofinterest are segmented or circumscribed in a general manner. Again, inimage data such feature segmentation may identify the limits ofanatomies or pathologies, and so forth. More generally, however, thesegmentation carried out at step 474 is intended to simply discern thelimits of any type of feature, including various relationships betweendata, extents of correlations, and so forth. Following suchsegmentation, features may be identified in the data as summarized atstep 476. While such feature identification may be accomplished onimaging data to identify specific anatomies or pathologies, it should beborne in mind that the feature identification carried out at step 476may be much broader in nature. That is, due to the wide range of datawhich may be integrated into the inventive system, the featureidentification may include associations of data, such as clinical datafrom all types of modalities, non-clinical data, demographic data, andso forth. In general, the feature identification may include any sort ofrecognition of correlations between the data that may be of interest forthe processes carried out by the CAX algorithm. At step 478 suchfeatures are classified. Such classification will typically includecomparison of profiles in the segmented feature with known profiles forknown conditions. The classification may generally result from parametersettings, values, and so forth which match such profiles in a knownpopulation of datasets with a dataset under consideration. However, theclassification may also be based upon non-parametric profile matching,such as through trend analysis for a particular patient or population ofpatients over time.

[0426] Based upon the processing carried out by the algorithm, a widerange of decisions may be made. As summarized in step 462, suchdecisions may include clinical decisions 480, therapeutic decisions 482,data acquisition decisions 484, data processing decisions 486, dataanalysis decisions 488, condition prediction or prognosis decisions 490,prescription recommendation or validation decisions 492, and assessmentof conditions 494. As noted above, the high level of integration of theprocessing operations provided by the present technique, and theintegration of data from a range of resources, permits any one of thecategories of functions carried out by the CAX algorithm to be modifiedor optimized, both for non-patient specific reasons and forpatient-specific reasons, as summarized in FIG. 28. Thus, as a result ofany one of the decisions made in the algorithm, modifications in thesame or different CAX algorithms may be made as summarized at step 496.As also noted below, such modifications may include selection of adifferent algorithm type, modification, addition or removal of one ormore functions carried out by the algorithm, or modification ofparameters and settings employed by the algorithm in carrying out thefunctions. Thus, in the flow diagram of FIG. 28, feedback may be had toany one of the steps summarized above including data acquisition,processing, analysis, feature identification, feature segmentation,feature classification, or any other function carried out within the CAXalgorithms. In general, some form of reporting or display of results ofthe algorithms will be provided as summarized at step 498.

[0427] In general, in the present context, each decision submodule has atask (e.g., acquisition) and a purpose (e.g., cancer detection)associated with it. Depending upon the task and the intended purpose,decision rules are established. In one implementation, a domain expertcan decide on the rules to be used for a given task and purpose. Inanother implementation, a library of rules relating to all possibletasks and purposes can be determined by a panel of experts and used bythe submodule. In another implementation, the library of rules can beaccessed from the integrated knowledge base. In another implementation,new rules may be stored in integrated knowledge base, but are derivedfrom other means prior to storage in the knowledge base. In a typicalimplementation, the combination of the current data and the rules areused to develop a summary of hypothesized decision options for the data.These options may lead to several outcomes, some of which may be desiredand some undesired. To obtain the optimal outcome, a metric isestablished to provide scores for each of the outcomes. Resultantoutcomes are thus evaluated, and the selected (i.e. optimal) outcomedetermines the function provided in the decision block.

[0428] As mentioned, the various CAX algorithms may be employedindividually or with some level of interaction. Moreover, the algorithmsmay be employed in the present technique without modification, or someor a high level of adaptability may be offered by virtue of integrationof additional data resources, and processing in the present system. Suchadaptation may be performed in real time or after or prior to dataacquisition events. Moreover, as noted above, triggering of execution oradaptation of CAX algorithms may be initiated by any range of initiationfactors, such as scheduled timing, operator intervention, change ofstate of data, and so forth. In general, a number of aspects of the CAXsystem or specific CAX algorithms may be altered. As summarized in FIG.29, the present technique envisages at a substantially new and differentapproach to compiling, analyzing and altering such CAX algorithms forthe adaptation and optimization provided.

[0429] Referring to FIG. 29, an overall CAX formulation, designatedgenerally by the reference numeral 500, may be represented by separatefunctionalities or parameters [i][J][k]. These aspects of the CAXalgorithms, in the present formulation, represent first the primary typeof function performed by the algorithm, as denoted by the list 502 inFIG. 29, the functions carried out by the algorithm, as denoted byreference numeral 504 in FIG. 29 and the specific data attributes 506employed in the algorithms. The algorithm designations 502 may followgeneral lines for functionality in the algorithms, although thoseskilled in the art will recognize that more than one such functionalitymay be employed, such as through subroutine, submodules, and the like.The [i] level of functionality in the algorithms may include a widerange of integrated or modular functions that are carried out in thevarious algorithms, some of which may be shared by a differentalgorithm. Noted in particular, in FIG. 29 are functions such as dataaccess, feature identification, analysis, segmentation, classification,decision, comparison, prediction, validation, and reconciliation. Otherfunctions may, of course, be employed as well. In general, in thepresent context such functionalities are implemented as submodules ofthe algorithms, and may generally be implemented as “tool kits” whichare called upon by the algorithm and developed by programming, expertsystems,, neural networks, and so forth as discussed above.

[0430] The [k] level of the CAX algorithm represents generally,variables or inputs that are used by the CAX algorithms for performingthe functions specified at the i] level. By way of example, in presentlycontemplated embodiments, items at the [k] level may include parameters,settings, values, ranges, patient-specific data, organ-specific data,condition-specific data, temporal data, and so forth. Such parametersand settings may be altered in the manner described above, such as forpatient-specific implementation of the CAX algorithm or for morebroadly-based changes as for a population of patients, institutions, andso forth. It should also be noted, that, as described above with respectto modeling, alterations made in a CAX algorithm may includeconsideration of data which was not considered prior to a modification.That is, as new data or new relationships are identified, the CAXalgorithm may be altered to accommodate consideration of the new data.As will be appreciated by those skilled in the art then, the high degreeof integration of the present technique allows for new and usefulrelationships to be identified among and between data from a wide rangeof resources and such knowledge incorporated into the CAX algorithm tofurther enhance its performance. Where available, the data may then beextracted from the integrated knowledge base or a portion of theknowledge base to carry out the function when called upon by the CAXalgorithm.

[0431] It should be noted that, while a single CAX algorithm may beimplemented in accordance with the present technique, a variety of CAXalgorithms may be implemented in parallel and in series for addressing awide range of conditions. As summarized in FIG. 30, for example, amulti-CAX implementation 508 may include a first type of algorithm 510,which may be any of the algorithms summarized above. Moreover, theselected type of algorithm may be implemented in parallel, such thatmultiple different or complementary functions may be executed. Each suchalgorithm will typically include fundamental operations such as noted atreference numeral 512. Such operations may generally resemble those ofCAD algorithms, including steps such as feature segmentation 514,feature identification 516, and feature classification 518. Based uponsuch steps, decisions may be made, such as for specific recommendationsfor future actions, as indicated at step 520. As noted above, based uponsuch operations, the algorithm may be modified, as noted at step 522.The modification is then implemented by returning to the system ormethod employed to generate or process the data, as noted at step 524.As noted above, the modifications may be made as various levels in thealgorithms, such as levels [i] and [k] discussed above.

[0432] As also summarized in FIG. 30, a number of CAX algorithms ofdifferent type (i.e. CAX[i]) may be executed in parallel, such as toidentify features of interest of different type, or from data ofdifferent type or modality. Such additional algorithms, designated byreference numerals 526 and 528 may include any of the algorithm typesdiscussed above. Similarly, CAX algorithms of the same or different typemay be executed in series, as indicated at reference numerals 530 and532 in FIG. 30. Such algorithms may, in fact, be selected based uponresults of earlier-executed algorithms.

[0433] While all of the CAX algorithms discussed above may haveapplication in addressing a range of clinical and non-clinical issues, amore complete discussion of certain of these is useful in understandingthe types of data operations performed by the modules or submodulesinvolved.

[0434] Computer-Assisted Diagnosis (CADx):

[0435] Computer-assisted diagnosis modules aid in identifying anddiagnosing specific conditions, typically in the area of medicalimaging. However, in accordance with the present technique, such modulesmay incorporate a much wider range of data, both from imaging types andmodalities, as well as from other types and modalities of resources. Thefollowing is a general description of an exemplary computer-assisteddiagnosis module. As described above and shown in FIG. 28, CADx consistsof a computer-assisted detection (CAD) module and a featureclassification block.

[0436] As described above, the medical practitioner derives informationregarding a medical condition from a variety of sources. The presenttechnique provides computer-assisted algorithms and techniques callingupon these sources from multi-modal and multi-dimensional perspectivesfor the detection and classification of a range of medical conditions inclinically relevant areas including (but not limited to) oncology,radiology, pathology, neurology, cardiology, orthopedics, and surgery.The condition identification can be in the form of screening using theanalysis of body fluids and detection alone (e.g., to determine thepresence or absence of suspicious candidate lesions) or in the form ofdiagnosis (e.g., for classification of detected lesions as either benignor malignant nodules). For the purposes of simplicity, one presentembodiment will be explained in terms of a CADx module to diagnosebenign or malignant lesions.

[0437] In the present context, a CADx module may have several parts,such as data sources, optimal feature selection, and classification,training, and display of results. Data sources, as discussed above, maytypically include image acquisition system information, diagnostic imagedata sets, electrical diagnostic data, clinical laboratory diagnosticdata from body fluids, histological diagnostic data, and patientdemographics/symptoms/history, such as smoking history, sex, age,clinical symptoms.

[0438] Feature selection may, itself comprise different types ofanalysis and processing, such as segmentation and feature extraction. Inthe data, a region of interest can be defined to calculate features. Theregion of interest can be defined in several ways, such as by using theentire data “as is,” or by using a part of the data, such as a candidatenodule region in the apical lung field. The segmentation of the regionof interest can be performed either manually or automatically. Themanual segmentation involves displaying the data and delineating theregion, such as by a user interfacing with the system in a computermouse. Automated segmentation algorithms can use prior knowledge, suchas the shape and size of a nodule, to automatically delineate the areaof interest. A semi-automated method which is the combination of theabove two methods may also be used.

[0439] The feature extraction process involves performing computationson the data sources. For example, in image-based data and for a regionof interest, statistics such as shape, size, density, curvature can becomputed. On acquisition-based and patient-based data, the datathemselves may serve as the features. Once the features are computed, apre-trained classification algorithm can be used to classify the regionsof interest as benign or malignant nodules. Bayesian classifiers, neuralnetworks, rule-based methods, fuzzy logic or other suitable techniquescan be used for classification. It should be noted here that CADxoperations may be performed once by incorporating features from alldata, or can be performed in parallel. The parallel operation wouldinvolve performing CADx operations individually on sets of data andcombining the results of some or all CADx operations (e.g., via AND, ORoperations or a combination of both). In addition, CADx operations todetect multiple disease states or medical conditions or events can beperformed in series or parallel.

[0440] Prior to classification, such as, of nodules, in the example,using a CAD module, prior knowledge from training of the module may beperformed. The training phase may involve the computation of severalcandidate features on known samples of benign and malignant nodules. Afeature selection algorithm is then employed to sort through thecandidate features and select only the useful ones, removing those thatprovide no information or redundant information. This decision is basedon classification results with different combinations of candidatefeatures. The feature selection algorithm is also used to reduce thedimensionality from a practical standpoint. Thus, in the example ofbreast mass analysis, a feature set is derived that can optimallydiscriminate benign nodules from malignant nodules. This optimal featureset is extracted on the regions of interest in the CAD module. Optimalfeature selection can be performed using a well-known distance measuretechniques including divergence measure, Bhattacharya distance,Mahalanobis distance, and so forth.

[0441] The proposed method enables, for example, the use of multiplebiomarkers for review by human or machine observers. CAD techniques mayoperate on some or all of the data, and display the results on each kindor set of data, or synthesize the results for display. This provides thebenefit of improving CAD performance by simplifying the segmentationprocess, while not increasing the quantity or type of data to bereviewed.

[0442] Again following the lesion analysis example, followingidentification and classification of a suspicious candidate lesion, itslocation and characteristics may be displayed to the reviewer of thedata. In certain CADx applications this is done through thesuperposition of a marker (for example an arrow or circle) near oraround the suspicious lesion. In other cases CAD and CADx afford theability to display computer detected and diagnosed markers on any ofmultiple data sets, respectively. In this way, the reviewer may view asingle data set upon which results from an array of CADx operations canbe superimposed (defined by a unique segmentation (i.e. regions ofinterest), feature extraction, and classification procedures).

[0443] Computer-Assisted Acquisition (CAA)

[0444] Computer-assisted acquisition processing modules may beimplemented to acquire further data, again from one or more types ofresources and one or more modalities within each type, to assist inenhanced understanding and diagnosis of patient conditions. Theacquisition of data may entail one or more patient visits, or sessions(including, for example, remote sessions with the patient), in whichadditional data is acquired based upon determinations made automaticallyby the data processing system 10. The information is preferably basedupon data available in the integrated database 12, to provide heretoforeunavailable levels of integration and acquisition of subsequent foradditional data for use in diagnosis and analysis.

[0445] In accordance with one aspect of the present technique, forexample, initial CAD processing may be used to guide additional dataacquisition with or without additional human operator assistance. CTlung screening will serve as an example of this interaction. Assumingfirst that original CT data is acquired with a 5 mm slice thickness.This is a common practice for many clinical sites to achieve a properbalance between diagnostic accuracy, patient dose, and number of imagesto review. Once the CAD algorithm identifies a suspicious site, thecomputer may automatically direct the CT scanner (or recommend to the CToperator) to re-acquire a set of thin slices at the suspected location(e.g., 1 mm slice thickness). In addition, an increased X-ray flux canbe used for better signal-to-noise. Because the location iswell-defined, the additional dose to the patient is kept to a minimum.The thin slice image provides better spatial resolution and, therefore,improved diagnostic accuracy. Advantages of such interactions includeimproved image quality and the avoidance of patient rescheduling. Itshould be noted that most of the diagnostic process generally occurslong after the patient has left the CT scanner room. In conventionalapproaches, if the radiologist needs thinner slices, the patient has tobe called back and re-scanned. Because scan landmarking is performedwith a scout image, the subsequent localization of the feature ofinterest is often quite poor. As a result, a larger volume of thepatient organ has to be re-scanned. This leads not only to lost time,but also an increased dose to the patient.

[0446] Although this example is for a single modality, the methodologycan be applied across modalities, and even across types of resources asdiscussed above, and over time. For example, the initial CAD informationgenerated with images acquired via a first modality may be used by theCAA algorithm to guide additional data acquisition via a modality B. Aspecific example of such interaction is the CAD detection of asuspicious nodule in chest x-ray guiding the acquisition of a thin slicehelical chest CT exam.

[0447] Computer-Assisted Processing (CAP)

[0448] Computer-assisted processing modules permit enhanced analysis ofdata which is already available through one or more acquisitionsessions. The processing may be based, again, one or more types ofresources, and on one or more modalities within each type. As also notedabove, while computer-assisted processing modules have been applied inthe past to single modalities, typically in the medical imaging context,the present technique contemplates the use of such modules in a muchbroader context by use of the various resources available and theintegrated knowledge base.

[0449] As an example, CAD generated information may be used to furtheroptimize the process of obtaining new images. Following data acquisitionand initial image formation (or based upon un-processed or partiallyprocessed data without image reconstruction), CAD modules may be used toperform the initial feature detection. Once potential pathology sitesare identified and characterized, a new set of images may be generatedby a CAA module based upon the findings. The new set of images may begenerated to assist the human observer's detection/classification task,or to improve the performance of other CAX algorithms.

[0450] For illustration, a CT lung-screening example is considered,although the approach may be, of course, generalized to other imagingmodalities, other resource types, and other pathologies. We assumeinitially that an image is reconstructed with a “Bone” (high-resolution)filter kernel and with a 40 cm reconstruction field of view (FOV). Oncea suspicious lung nodule is identified, a CAP module may reconstruct anew set of images at the suspected location with the original scan data.For example, a first images with a “Standard” (lower resolution kernel)filter kernel may first be reconstructed. Although the Standard kernelproduces poor spatial resolution, it has the property of maintainingaccurate CT numbers. Combining such images with those produced via theBone algorithm, a CAP algorithm can separate calcified nodules from thenon-calcified nodules based on their CT number. Additionally, the CAPmodule may perform targeted reconstruction at the suspected locations toprovide improved spatial resolution, or to improve algorithm performanceand/or to facilitate human observer analysis. By way of further example,for a present CT scanner, typical image size is 512×512 pixels. For a 40cm reconstruction FOV, each pixel is roughly 0.8 mm along a side. From aNyquist sampling point of view, this insufficient to support highspatial resolutions. When the CAP module re-generates the image,however, with a 10 cm FOV at a suspicious site, each pixel is roughly0.2 mm along a side and, therefore, can support much higher spatialresolution. Because the additional reconstruction and processing isperformed only at the isolated sites, instead of the entire volume, theamount of image processing, reconstruction, and storage becomes quitemanageable. It should be noted that a simple example is presented herefor the purpose of illustration. Other processing steps (such as imageenhancement, local 3D modeling, image reformation, etc.) could also beperformed with under the guidance of the CAP module, such as based onthe initial CAD result and the results of further processing. Theadditional images can be used either to refine the original findings ofCAD processing, as input to further CAX analyses, or may be presented tothe radiologists.

[0451] Computer-Assisted Prognosis (CAPx)

[0452] Medical prognosis is an estimate of cure, complication,recurrence of disease, length of stay in health care facilities orsurvival for a patient or group of patients. The simplistic meaning ofprognosis is a prediction of the future course and outcome of a diseaseand an indication of the likelihood of recovery from that disease.

[0453] Computational prognostic model may be used, in accordance withthe present technique to predict the natural course of disease, or theexpected outcome after treatment. Prognosis forms an integral part ofsystems for treatment selection and treatment planning. Furthermore,prognostic models may play an important role in guiding diagnosticproblem solving, e.g. by only requesting information concerning tests,of which the outcome affects knowledge of the prognosis.

[0454] In recent years several methods and techniques from the fields ofartificial intelligence, decision theory and statistics have beenintroduced into models of the medical management of patients (diagnosis,treatment, follow-up); in some of these models, assessment of theexpected prognosis constitutes an integral part. Typically, recentprognostic methods rely on explicit patho-physiological models, whichmay be combined with traditional models of life expectancy. Examples ofsuch domain models are causal disease models, and physiological modelsof regulatory mechanisms in the human body. Such model-based approacheshave the potential to facilitate the development of knowledge-basedsystems, because the medical domain models can be partially obtainedfrom the medical literature.

[0455] Various methods have been suggested for the representations ofsuch domain models ranging from quantitative and probabilisticapproaches to symbolic and qualitative ones. Semantic concepts such astime, e.g. for modeling the progressive changes of regulatorymechanisms, have formed an important and challenging modeling issue.Moreover, automatic learning techniques of such models have beenproposed. When model construction is hard, less explicit domain modelshave been studied such as the use of case-based representations and itscombination with more explicit domain models.

[0456] Computer-Assisted Assessment (CAAx)

[0457] Computer-assisted assessment modules may include algorithms foranalyzing a wide range of conditions or situations. By way of example,such algorithms may be employed to evaluate the outcome of a medicalprocedure (e.g., surgery), the outcome of therapy due to an injury (e.g.spinal injury), conditions (e.g. pregnancy), situations (e.g. trauma),processes (e.g. insurance, reimbursement, equipment utilization), andindividuals (e.g. patients, students, medical professionals).

[0458] Certain exemplary steps in a CAAx algorithm are illustratedgenerally in FIG. 31. The algorithm 534 begins with input of key data atstep 536. Depending upon the purpose of the algorithm, such data mayinclude a designation or description of a situation, task, availableresults, intended person, requested information, and so forth. The datais used to identify a desired software tool, as indicated at step 538,which may take the form of a “wizard” used as an interface to lead auser through the assessment process. The interface may be at leastpartially based upon input from a professional or expert in the field ofthe operations executed by the algorithm or in the field of the data orassessment to be performed.

[0459] At step 540, more specific information may be evoked from one ormore users, or automatically acquired or accessed from the variousresources described above. Where the data is input by an individual, acustomized interface may be provided in a manner described above, suchas via the unfederated interface layer 222, drawing upon informationfrom the integrated knowledge base 12 and data resources 18. As notedabove, such interfaces may be customized for the particular user, thefunction performed, the data to be provided or accessed, and so forth.

[0460] Based upon the information provided, assessment is performed, asindicated at step 542. Such assessment will generally vary widely basedupon the condition, situation, or other issue being evaluated. In apresently contemplated implementation, a score is determined from theassessment, and a comparison is performed based upon the score at step544. The comparison is then the basis of a recommendation for furtheraction, or may simply serve as the basis for reported results of theassessment. Moreover, results of the process may optionally bereconciled, where potential conflicts or judgments are in order, asindicated at step 546, including input from a human expert, wheredesired.

[0461] Business Model Implementation

[0462] The foregoing techniques permit implementation in a wide range ofmanners. For example, as noted repeatedly, the use of data and theinteraction between data and modules may be implemented on a very smallscale, including at a single workstation. Higher levels of integrationmay be provided by network links between various types of resources andworkstations, and at various levels between network components as alsodescribed above. It should also be noted that the present techniques maybe implemented as overall business models within an industry or aportion of an industry.

[0463] The business model implementation for the present techniques mayinclude software installed on one or more memory devices ormachine-readable media, such as disks, hard drives, flash memory, and soforth. A user may then employ the techniques individually, or by accessto specific sites, links, services, databases, and so forth through anetwork. Similarly, a business model based upon the techniques may bedeveloped such that the technique is offered on a pay-per-use,subscription, or any other suitable basis.

[0464] Such business models may be employed for any or all of theforegoing techniques, and may be offered on a “modular” basis. By way ofexample, institutions may subscribe or order services for evaluation ofpatient populations, scheduling of services and resources, developmentof models for prediction of patient conditions, training purposes, andso forth. Individuals or institutions may subscribe or purchase similarservices for maintenance of individual patient records, integration ofrecords, and the like. Certain of the techniques may be offered inconjunction with other assets or services, such as imaging systems,workstations, management networks, and so forth.

[0465] As will be appreciated by those skilled in the art, the businessmodels built upon the foregoing techniques may employ a wide range ofsupport software and hardware, including servers, drivers, translators,and so forth which permit or facilitate interaction with databases,processing resources, and the data and controllable and prescribableresources described above. Supporting components which provide forsecurity, verification, interfacing and synchronization of data may beincorporated into such systems, or may be distributed among the systemsand the various users or clients. Financial support modules, includingmodules which permit tracking and invoicing for services may beincorporated in a similar manner.

[0466] It is similarly contemplated that certain of the foregoingtechniques may be implemented in sector-wide or industry-wide manners.Thus, high levels of integration may be enabled by appropriatelystandardizing or tagging data for access, exchange, uploading,downloading, translation, processing, and so forth.

[0467] While the invention may be susceptible to various modificationsand alternative forms, specific embodiments have been shown by way ofexample in the drawings and have been described in detail herein.However, it should be understood that the invention is not intended tobe limited to the particular forms disclosed. Rather, the invention isto cover all modifications, equivalents, and alternatives falling withinthe spirit and scope of the invention as defined by the followingappended claims.

What is claimed is:
 1. A method for improving performance of acomputer-assisted data operating algorithm, the method comprising:analyzing a data set via a computer-assisted data operating algorithm togenerate a result data set identifying a feature of interest; monitoringfor changes in the result data set based upon input from a human expert;and modifying at least one submodule of the computer-assisted dataoperating algorithm without operator intervention based upon themodified result data set.
 2. The method of claim 1, wherein the data setis representative of an image, and wherein the method further comprisesdisplaying a reconstructed image based upon the result data set formodification by the human expert.
 3. The method of claim 1, furthercomprising validating a modification of the computer-assisted dataoperating algorithm prior to modifying the at least one submodule. 4.The method of claim 1, wherein data operating algorithm is selected froma group consisting of computer-assisted detection algorithms,computer-assisted diagnosis algorithms, computer-assisted decisionsupport algorithms, computer-assisted acquisition algorithms,computer-assisted analysis algorithms, computer-assisted processingalgorithms, computer-assisted prognosis algorithms, computer-assistedtreatment algorithms, computer-assisted prescription algorithms, andcomputer-assisted assessment algorithms.
 5. The method of claim 1,wherein the submodule affects feature detection performed by thealgorithm.
 6. The method of claim 1, wherein the submodule affectsfeature segmentation performed by the algorithm.
 7. The method of claim1, wherein the submodule affects feature classification performed by thealgorithm.
 8. A method for improving performance of a computer-assistedmedical data operating algorithm, the method comprising: analyzing adata set via a computer-assisted data operating algorithm to generate aresult data set identifying a feature of interest; and modifying atleast one submodule of the computer-assisted data operating algorithm ona patient-specific basis.
 9. The method of claim 8, wherein thesubmodule affects feature detection performed by the algorithm.
 10. Themethod of claim 8, wherein the submodule affects feature segmentationperformed by the algorithm.
 11. The method of claim 8, wherein thesubmodule affects feature classification performed by the algorithm. 12.The method of claim 8, wherein the algorithm is modified for apopulation of patients based upon a characteristic shared by members ofthe population.
 13. A method for improving performance of acomputer-assisted data operating algorithm, the method comprising:accessing image data derived from a medical imaging system, andsupplemental data from an integrated knowledge base including clinicaland non-clinical data from a plurality of controllable and prescribabledata resources; analyzing the image data and the supplemental data via acomputer-assisted data operating algorithm to generate a result data setidentifying a feature of interest in the image data; modifying theresult data set based upon correction by a human medical professional;and modifying at least one submodule of the computer-assisted dataoperating algorithm based upon the modified result data set.
 14. Themethod of claim 13, wherein the modification to the at least onesubmodule is a patient-specific parameter.
 15. The method of claim 14,wherein the submodule is modified for a population of patients basedupon a characteristic shared by members of the population.
 16. Themethod of claim 13, wherein the supplemental data is patient-specific.17. The method of claim 13, wherein the supplemental data includes dataselected from a group consisting of electrical resource data, imagingresource data, laboratory data, histologic data, financial data, anddemographic data.
 18. The method of claim 13, comprising displaying areconstructed image based upon the result data set for modification bythe human medical professional.
 19. The method of claim 13, furthercomprising validating that a modification of the computer-assisted dataoperating algorithm is desired prior to modifying the at least oneparameter.
 20. The method of claim 13, wherein the computer-assisteddata operating algorithm is a computer-assisted diagnosis algorithm. 21.The method of claim 13, wherein the data operating algorithm is selectedfrom a group consisting of computer-assisted detection algorithms,computer-assisted diagnosis algorithms, computer-assisted decisionsupport algorithms, computer-assisted acquisition algorithms,computer-assisted analysis algorithms, computer-assisted processingalgorithms, computer-assisted prognosis algorithms, computer-assistedtreatment algorithms, computer-assisted prescription algorithms, andcomputer-assisted assessment algorithms.
 22. The method of claim 13,wherein the parameter affects feature detection performed by thealgorithm.
 23. The method of claim 13, wherein the parameter affectsfeature segmentation performed by the algorithm.
 24. The method of claim13, wherein the parameter affects feature classification performed bythe algorithm.
 25. A system for processing medical image datacomprising: a data repository for storing a medical image data set; aprogrammed computer system configured to analyze a data set via acomputer-assisted data operating algorithm to generate a result data setidentifying a feature of interest, to monitor for changes in the resultdata set based upon input from a human expert, and to modify at leastone submodule of the computer-assisted operating algorithm withoutoperator intervention based upon the modified result data set.
 26. Thesystem of claim 25, further comprising a display device for displaying areconstructed image based upon the result data set for modification bythe human medical professional.
 27. The system of claim 25, wherein themodification to the at least one parameter is patient-specific.
 28. Thesystem of claim 25, wherein the data repository comprises an integratedknowledge base configured to store data from a plurality of controllableand prescribable data resources, and wherein the computer system isconfigured to store the parameter modification in an integratedknowledge base.
 29. The system of claim 25, wherein thecomputer-assisted data operating algorithm is a computer-assisteddiagnosis algorithm.
 30. The system of claim 25, wherein thecomputer-assisted data operating algorithm is a computer-assistedprocessing algorithm.
 31. The system of claim 25, wherein thecomputer-assisted data operating algorithm is a computer-assistedacquisition algorithm.
 32. A system for processing medical image datacomprising: an integrated knowledge base storing clinical andnon-clinical data from a plurality of controllable and prescribable dataresources, including medical image data derived from a medical imagingsystem and supplemental data; a programmed computer system configured toaccess image data and supplemental data from the integrated knowledgebase, to analyze the image data and the supplemental data via acomputer-assisted data operating algorithm to generate a result data setidentifying a feature of interest in the image data, and to modify atleast one submodule of the computer-assisted data operating algorithmbased upon correction of the result data set by a human medicalprofessional.
 33. The system of claim 32, wherein the modification tothe at least one parameter is patient-specific.
 34. The system of claim32, wherein the supplemental data is patient-specific.
 35. The system ofclaim 32, wherein the supplemental data includes data selected from agroup consisting of electrical resource data, imaging resource data,laboratory data, histologic data, financial data, and demographic data.36. The system of claim 32, further comprising a display device fordisplaying a reconstructed image based upon the result data set formodification by the human medical professional.
 37. The system of claim32, wherein the computer-assisted data operating algorithm is acomputer-assisted diagnosis algorithm.
 38. The system of claim 32,wherein the computer-assisted data operating algorithm is acomputer-assisted processing algorithm.
 39. The system of claim 32,wherein the computer-assisted data operating algorithm is acomputer-assisted acquisition algorithm.
 40. A system for improvingperformance of a computer-assisted medical data operating algorithmcomprising: means for analyzing a data set via a computer-assisted dataoperating algorithm to generate a result data set identifying a featureof interest; means for monitoring for changes in the result data setbased upon input from a human expert; and means for modifying at leastone submodule of the computer-assisted operating algorithm withoutoperator intervention based upon the modified result data set.
 41. Asystem for improving performance of a computer-assisted medical dataoperating algorithm comprising: means for analyzing a data set via acomputer-assisted data operating algorithm to generate a result data setidentifying a feature of interest; and means for modifying at least onesubmodule of the computer-assisted operating algorithm on apatient-specific basis.
 42. A system for improving performance of acomputer-assisted data operating algorithm comprising: means foraccessing image data derived from a medical imaging system, andsupplemental data from an integrated knowledge base including clinicaland non-clinical data from a plurality of controllable and prescribabledata resources; means for analyzing the image data and the supplementaldata via a computer-assisted data operating algorithm to generate aresult data set identifying a feature of interest in the image data;means for modifying the result data set based upon correction by a humanmedical professional; and means for modifying at least one submodule ofthe computer-assisted data operating algorithm based upon the modifiedresult data set.
 43. A computer executable program comprising: at leastone machine readable medium; computer code stored on the at least onemachine readable medium comprising instructions for analyzing a data setvia a computer-assisted data operating algorithm to generate a resultdata set identifying a feature of interest, monitoring for changes inthe result data set based upon input from a human expert, and modifyingat least one submodule of the computer-assisted operating algorithmwithout operator intervention based upon the modified result data set.44. A computer executable program comprising: at least one machinereadable medium; computer code stored on the at least one machinereadable medium comprising instructions for analyzing a data set via acomputer-assisted data operating algorithm to generate a result data setidentifying a feature of interest and modifying at least one submoduleof the computer-assisted operating algorithm on a patient-specificbasis.
 45. A computer executable program comprising: at least onemachine readable medium; computer code stored on the at least onemachine readable medium comprising instructions for accessing image dataderived from a medical imaging system, and supplemental data from anintegrated knowledge base including clinical and non-clinical data froma plurality of controllable and prescribable data resources, analyzingthe image data and the supplemental data via a computer-assisted dataoperating algorithm to generate a result data set identifying a featureof interest in the image data, modifying the result data set based uponcorrection by a human medical professional, and modifying at least onesubmodule of the computer-assisted data operating algorithm based uponthe modified result data set.